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ABSTRACT 

Updating a 1978 literature review, this document 
assembles five articl^es anaijyzing recent research oi) how various 
types of . educatic>nai agencies disseminate information for school^ - 
improvement. Each artixrl^sumraaTiWs~]rrteratTOre-T:eleva^ 
of educational agency, di^tusses interrelationships among the 
.i;esearch findings, and assesses the implications for federal policy 
and further research. In the first article, Michael Fullan 
synthesizes recent findings on local educational ag^g'ncies' use of . 
external resources to improve schools and suggests four types of 
needed researc^^ David Clark analyzes reports on the role played in 
school improvement by schools, colleges , cand departments of education 
within institjutions* of higher education, and calls for further 
descriptive and evaluative data. In the third article, Carolyn Moran 
and Larry HUtchins examine educational service agencies (including 
"intermediate" and "regional" service centers) and ponder the 
implications of federal funding cutbacks. Regional education 
laboratories and universijty centers are covered by* Leslie Salmon-Cox, 
who recommends continued support for these research and developmiant 
agencies. Finally, Henry M. Brickell raises questions about the role 
of state department's of education'^in future dissemination and school 
improvements efforts.* (Author/RW). - - 
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PREFACE 



The collection of papers that appear in this report *is the result 
of a collaborative effort among tTue National Institute* of -Education^/ 
the Fa> West Laboratory for Educational Research and' Development , and 
student? and practitioners ^of educational dissemination and sctiool im- 
provement activities. Begun in 1978 v5ith-thfe publication of John Emrick 
and Susan- Peterson\s* A Synthesis of Findings Across Five Recent Studies 
o'f-^ducational Dissemination and Change (Far West laboratory^ 1978), an 
impressive series of over 30 papers representing the contributions of 
many scholars ^'nd practitioners from throughout the country ha^ fol- 
lowed/ Each bf the 'papets has been related to dissemination and the 
use of Information for the'imp^f»oyeniept. of educational practice^ ► 

•The recently published Improving Schools: Using What We Know ,. 
edited \by RTolf Lehming and Michael Kane* of the National Institute of 

^Eduratibh .(Sage Publications, 1981) and the selective summary of. thati 

'volume prepared especially fB^pr;actitioners; Using Knowledge for 
SthQol ' Improvement: A tSuide f&kEducatorl , edited by Sue McKibbin, ' 
Ami Lieberman, and David Degeher, (Far West Labo^tory, ,1981) signifi- 
cantly contribjjte to a m^'or goal of this Educational Dissemination 

'Studies Program (EBSP) publication ^series; namely, to^define areas of 
agreement and disagreement with the" research,' development, and prac-' 
tice communities on those factors that are* most important in supporting 
the process of educational' improvement. ^ • ' 

* " * ^ * ... 

With the recent shift in federal educational policy toward greater 
emphasis on state and local educational agencies and encouraging more 
extjensive use of* the'capaonties of other existing educational support 
organizations, a syntheses and .assessment of selected literature des- 
cribing the v.ar-iouS'^ major types of educational agencies in terms Of 
their school improvement- capacity seemed timely and useful. \ EDSP pub- 
lished a comprehensive review of 'the 1-^erature in this area in 1978 
(Paul.D. Hood et aU'; Statewide Educaticma.r Disssemination Capacity: 
A'Review ^o'f; Recent Literature and Current I^nformation , Far West 
Laboratory)." During- the jsnsuing fpur -years, -mucJi-^ new research has ^--^ — ^- 

''been procfaced, and an updat^ is in-order*^^ Moreover, while the earlier 
EDSP. review was almost entirely descriptive, '*the current, peport goes 
beyond' desci^ipt ion* to ^c^nal^ is and assessment In terms of implications 

' for federal policy.^ Betdus,^ the authors of^^l^i^neTi ve papers are each 
unusi^l >y'\el l-quA] ified .to*review and interpret the literature in ^ , 
therji^ assigned arfeas* the J.ncirvi dual papers deserve special attentioiY 
on/lfhe part of anyone, seepng^'^a, cogent and useful orientation to state, 
i^nterhipdiat^,- or tocal educational agencies', colleges of education, or ' 
regirohal educatif)nal laboratories and,R&D centers as research and 

, prdttlce improvement agencies, 

Paul D\i5ood ' ' • 
Educatioffal Dissemination Studres"Program ^ 
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In the spring' of 198*1, the Educational Dissemination Studfes Pro- 
gram (EDSP) proposed to synthesize and interrelate selected studies and 
'research reports describing how various types of organizations dissemi- 
nate info'rmation for school, improvement. The synthesis was designed\to 
provide the Research; and Educational Practice Unit at the^ational iTist 
tute tff Education with additional insights into recent research grouped 
by five organizational types: school districts; schools, colleges, and 
departments of education (SCDEs); intermediate service agencies (ISAs); 
laboratories and-centers; and state education agencies (SEAs). 

This document presents five papers, each of which summarizes and 
interrelates relevant research. Implications for federal policy Jon 
dissemination for schooV improvement' are then discussed in the papers. 
Uniq-ue conclusions emerge from ea£b work; 

• After synthesizing*recent research on the use of ex- 
ternal resources for school improvement by local educa- 

' ^tion agencies, MichaeLFul Ian suggests four types' of ' • 
studies that should be placed on the national research 
agenda for LEAs. 

• David 'Clark provides thorough , summaries and -cross-case 
analyses of research reports on schools, colleges, and - 
departments of education. He concludes that because ^ 

o SCDEs will continue to pl^fy an important role in dis- 
semination and school improvement activities, descrip- 
tive and evaluative dat^ about their activities should 
be .collected. ^ ^'^^^ 

% Carolyn Moran and \.^rrf Hutchins con^l^de from the re-^ 
.search that although intermediate service agencies 
represent a significant capacity foi^'educatiohal im- . 
; *^ provement, their future role in the dissemination ' 
^ r 'process is jeopardized by impending federal -ciithacks 
• ' . in funding. • * - * t 
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Leslie Salmon-Cox traces the development of labs and 
centers, recommending that NIE continue' the support . 
for these organizations in" order to maintain an 
institutional capacity for ejRational problem^ol ving. 

• tn his ess£^ on state educat^^agencies, Henry 
Brjckel4 argues that federally supported SEA efforts to 
improve schools beyond minimum educational needs are not 
likely to be maintained by states when federal funding 
is eliminated. After exami^ning dissemination as a field 

j^of study,' Brickel 1 offers implications^for NIE research 

*on the role of SEAs in dissemination* 



Vll 



Each paper has three components: summaries of rese^ch relevant 
to the organ T2ationa,l type being corvsidered; a j?^arison of these ' 
research findings and a discussion of their in/^r^ationshi^s; ^and 
policy implications for, fxJrther research on dyssemination anci ^hool 
improvement. Although the papers vary in the/way they addres-s these 
three com'ponents, the Assent i.al contents of ea^h can be found in every 
paper. ' • 

The literature included in the five syntheses was selected by 
NlE*s Research and* Evaluation/Practice staff in consul1;ation with 
staff of the Educational Di ssemfnationvStudies Program at Far West ^ 
Laboratory. The papers are flot intended to provide comprehensive 
reviews of ' the Ijterature-; rather^ their purpose i^ to-aaalyze sign- 
ificant key. documents of special interest to NIE and dissemination 
practitioners..^ One study, Performers of Research and ResearcH-related 
Activities in the Field of-.Education ^by Frankel, Sharp and Biderman^ 
wa^ included in several of the review^ because it surveyed a broad 
spectrum of organizational types. 

The five papers in this collection offer informative, thought- 
provoking ^perspectiv'es on the roles that vartous educational organ- 
izations play in disseminating information for sChooT improvement.^ 



t \ 
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, Introduction. 

« 

This paper will revlev/ and synthesize selected research studies 
on the topic oi' local education agency (LEA) use of, external resources 
for school improvement. The paper, is divided into three main sections. 
Section I contains a short summary of four individual research studies, 
'in which the'main findings of the reports are highlighted* *Also in- " 
eluded in Settion I- are a small number of references to other recent 
research studies that make an i^nportant contribution to the topic under 
consideration. Section II contains 'a cross-comparison of the four stud- 
ies and other references mentio^ned i-n-.5jBCtion I^-,R0ti4ig sifnilarities* and 
differences. While .Sfection I contains .a brief descrif3tive overview of 
findings. Section II examines cross-compari^sons using a more analytical 
framework. In the fl^Hal section, -Questions of definitian of key terms, 
research gaps, and promising lines' of inquiry are noted for the.^purpose 
of suggesting a research agenda on*LEAs' use of external resources for 
school improvement. 

, . I : 

Three, other pre^nnvfriary comments shoufd be made.. First, dtscussitfp' 
^f the problem of defining terms like "external resources" and "school 
improvement" will te postponed until the final section. At this point, 
it should be sufficient to note t-h^at external resources include informa- 
tion, programs or products, and people relevant to tbe provision of as- 
sistance for school improvement. 3thool ^jiwg^pvement is conceived very 
brbad^ly to include' any individual or organizational outcome represent- 
ing an improvement over existing cooditions* A second introSuctory 
comment; My task was to foc4J*s on a smalT number of selected reports, 
not on the field as a whole. A thorough yev^iew would no doubt turn up /. 

rmore information, although such a review would be complicatecj by the' 
fact that LEA^^'use of external resourced" is n'ot^ell derfined in most 
research studies of 4ocal' districts.' A third and related point is that 

_L"EA use of external ^.resources appears to be a neglected topic of study. 
if v/e> use^he LEA as the unit of analysis , i.e., if we examine use 
-Of resources from the perspective of the LEM^-There have been several 
excellent studies of ifie role of external consultants, or of the fate^ 
of individual program innovations, but not of thg LE^ as an entity 
vis-arvis the ecology of resource utili>zation. 



^ . Section K A/ Summary of Selected Studies ^ 

• ^ - . - /• • - 

' The four primary studi6s*to be reviewed are: Adams's A 'Survey » ^ 
• of the Capacity of Selected Urban School Districts to Utilize and Pis - - 
^ ' seminate./lnnovatii)ns ^ EduCiational Technology (1978); the Alkin et a1 • 
. ^ case , studs' e^s of '1 FVbPKhuol districts, Using Evaluations (T5Z9); the 

" Lyon-et a]. Survey of Evaluation and;~Sphoo1 Districts (1978); and por- 
tions of the Frankel et aU work^&n t^erformers of Research and Research- 
Related Activities in the Field of Education (1979)* Four other stud- 
ies win be referred to although not summarized: (1) the Huron Insti- 
^ tute's study on The Role of Evaluation and Test Information in Pu6'Kic 

Schools (Kennedy .^t ,al . , 19§0); (2) Bank's extension, of the Lyenn study, 
^ School District Management Strategies' to Link Testing with Instructional 
t » Change . (1981 ); (,3) the large-scale St-udy of Dissemi-nation Efforts Suf? - 

porting School Improvement (Crandall et aT. , f/Trthcoming) ; and (4) the . 
^ > study of Researcf) and Development Utilization (RDU)' (Louis -ancf Rosen- 

b1uni>^1981 )r^or furth^er research see also the chapter in.Fullan (1982) 
f on the role of^school districts' in educational change, which describes- 

findfngs based on research in several school districts. 

^. ■ ■ J ^ 

, I. ■Adams. A Survey of the Capacity Selected Urban School Districts, 
to LTtil fze-and Disseminate Innovation^ in Educational Technology 

TTmy. — ; ■ ; ■< ^- 

M ^ The Adams study is based on "an informal surv% of 27 large urjpau 

school districts to inquire about their capacities to adapt, utilize and 
especially to disseminate innovations in education" (p.1). A telephone' 
. ^ survey was conducted, usually focusing on the heads of departments of 
planning, research*, or evaluation. Adams classifies the di-stricts into 
• three .groups: those wrth fqrmal institutionalized processes to identify, 
evaluate, and adapt innovati^Tfs'^(N=12) ; those districts in which the 
' \- process of knowledge utilization is highly routinized as an ongoing 
_ function of .'the basic administrative structure (N=8) and those that 
. have no formal mechanism for dealing with innovations (N=7)'. There 
«are brief comments *on each district. 

The Adam's^'^'study mark:e§ vVtually no contribution to ouc goal of ^ 
finding out how distr-icts use resources. The study does not address 
its own key questian concerning the "capacityt" of di'stricts to utilize 
* innovations. The information^ presented is extremely supe^'rf icial and 



*Each study summary i s very brief, provid'lng only highlights. The 
purpose IS to set the context for m^fr^^arialytidal discus^ioh in 
Sections II and III. ^ • 
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selective, the conceptual diistjnct io.n between the first two groups of 
distric.ts is unclear,' and there are really no "findings" beyond a few 
arf hoc, undevelpped statements.* • . ^ ' 

« 9 

^ The report's one substantive contribution* comes in the appendix by 
Fleming , which describes a multi-year^reform effort in the Cleveland pub- 
lic schools. The description, essentjially relating to insularity and lack 
of coordinatiqn among major .groups and elements in the change process, 
identifies" a number x)f problems refevant to our review. These problems 
include: (1) school planning teams isolated from central district staff; 
(2) use of outsi,de^i stri.ct consultants w.ithout provision for follow- 
through; (3) staff g^lopment programs not explicitly focused on the 
demands of the' change programs, lacking follow^.through support and evalua- 
tion, and conducted in rsx)lation from district^'support staff; and (4) an t 
overall breakdown of the evaluative information-gathering system due to 
mistrust and lack of coordjnation. These "negative" findings are con- 
sistent with, those from more^^-^positive" cases referred to later, where 
planning, staff development, and information-gathering>> systems are 
linked more- tightly to school improvement systems. 



M. Alkin et a-h Using Evaluatio ns: Does Evaluation Make a Differenced 
(1979). : . S ^ 



ATkln et al. conducted case studies concerning the role of evalua- 
tion of ESEA Title I or Title IV-C programs in five "school districts.** 

.The five cases were selected on the basis; of referrals from professional 
colleagLues, proximity to the researchers' home Jbase, and relative.com- ^ 
pleteness of data. An attempt. was made^-b avoi.d "showcase" examples:. 

•A brief profile of the five districts '(Wentifi^d &y\pseudonyms) ^ 
follows: ' 



The author, notes that the* study was informal and the results tenta- 
tive; but in my assessment, there was little we could confidently^ 
refer to as- "results. " * ' ' ' 

k} 

** Title I (funds for programs, for the disadvantaged) and' Title IV-C 
(formerly Title III, providing monies for Innovativ^progi^ams) are 
funded by the federal government* and, administered through state de- 
partments of edudatten. Evaluation *of tlie programs is a requ1r*ement^ 
for the receipt of funds. ^ . • ' 



Fi\gure 1* Profi.le of Districts 



r 



District Pobulation 

Bay view McNaught Jr. 

High, n^O 
students-^-eS?; 
' ^ black, 22% 
Mexican- 
American,* 
. 13%^white) ' 



Valfex Sierra Elefnen- 
Vist-^ ^ tary Scho6l , 
^"780 students 
(70% blacks 
^ 11%* Mexican- 

American, V 
16% white, 
3% Asian^ 
• < . • 

Rockland . Five of 13 ele- 
mentary schools 
' ' * in the district 

^ qualifying far 
Title I (mostly 
white;, 12-15% 
' Mexican-American) 



Clayburne Edison High ^• 

School (up to . ^ 
250 students, 
• mostly middle- 
Ibwer-tlass 
whites,^ mi nt)rity 
enrollment "well • 
btelow city average") 

Garrison McNair Elementary 
School tl200 stu- 
dents, up to 540 
involved in the pro- 
gram; population 99% 
Mexican-American 
with large percen- 
tage monolingual 
Spanish speakiag in 
early grades) 



^ •Program 

,MORE (Motivation 
for Retention-- 

* Title in/IV-C 
project designed 
to*Veduce iru^ncy 
and ^y-opout by 
^'improving' overal 1^^ 
academic achieve- 
ment and general* 
learning environ- 
ment") 

IGE (individually 
Guiderf Education, 
Title I program; 
IGE is a program 
designed to irn- 
prov^< achievement * 
through individu- 
alization. ) 

K-LEAD (Title, I 
program; a kinder- 
garten learning 
diagnosis and reme- 
dial program in vol V- * 
ing 120 chpdren-- 
24 from^ eaoi of the 
. Title l\schools) 

Outreach (Title III/ 
IV-C project--an ex- 
perimental alternar 
tive career high 

• school focusing on 
career training i on- 
the-job training, and 
placement) 




Altern^aJ:e Language 
Strategies for the 
Second-Language 
learner (Title IV-C-- 
a bill ngual program 
designed to involve 
students in the de- 
velopment of bilingual- 
biQultural materials) 



Primary Mover 

incipal , V-P, and'' 
^^cher-counsellor ^ 
viking with dis- 
trict's special 
projects office 
wrote Title IV-C 
proposal • ' , / 



Unclear, Apparently 
district administVa- 
rtion brought IGE to 
the attentfon of 
Title I sc&ools and 
principal end* staff 
of Sierra decided ^ 
to adopt it 

District .requested a 
school psychologist 
to write a proposal 
and direct implemen- 
tation of tfie Title 
I program. Close 
working relationship 
with principals 

District evaluator 
wrote profDOsal , 
associate superin- 
tendent strong pro- 
ponent ' 



School principal and 
a teacher wrote 
Title IV-C proposal 



ERIC 



It Is very difficult to summarize the main- findings of the Alkin 
case studies. The five cases by definition used extern-al resouiices for 
the funding of. programs. In four of the five cases (the exception ^belng 
Valley Vista IGE), the proposals were written by personnel Internal' to 
the district. It Is unclear, however, how cnuch use was made of external 
Information, Ideas, and the like In the preparation of these proposals. 
The use of external resources for Staff . development Is also not clear, 
although staff development was part of each program. The question of 
resource utilization is further complicated because there were ^at^ least" 
two separate but. overlapping- aspects in the cases--one pertainfng' to 
resource use for program adoption and Improvement, the other tq the 
more specific question of evaluation utilization (the primary interest 
of Alkin' s study). ' , " . ■ 

Alkin and associates do a, nice job of Identifying the multiple 
facets of evaluation use. They found that the foritial evaluation re- 
ports were used^ actively in only two of the cases* (in Rockland, in mak- 
ing decisions about prograni continuance; and in Garrison, jn altering 
'community, distrnct, and funding attitudes). In' every case, Alkin 
fountj that informal evaluation activities ' (mini-reports, feedback 
sessions, informal discussions with evaluators or among users) had a 
variety of impacts on program leaders and participants, although it 
was difficult to identify the influences precisely. 

Finally, Alkjn et al. list eight categories of factors that they 
believe affect evalii^tion utilization: (1) pre-existing evaluation 
bounds (e.g., mandated requirements), (2) ori'entation of the users ^ 
(e.g., information interests of i^seps), (3) the eyaluator's ap.prdach 
(e.g., involving users, facilitating use of information), (4) evaluator 
credibility (e.g.., specificity of credibility vis-a-vis the program), 

(5) organizational factors (e.g., district offfce/school site inter,-. 
relatioriship--which incidentally in most cases was not very^ close), 

(6) extra-organizational factors (e.g., community and government agency 
influence), (7) information content and reporting (e.g., for:mat and 
substance in terms of test data,, program implementation information) , 
and (8) administrator style (defined as organizational -skills and ini- ^ 
tiative). 

We will have more to say about the Alkin report in Section *'I I, but 
all in all it v/^s not intended to zero in on external re^sources and 
their impact on improvement . Therefore, while some of the findings 
are relevant^ to these topics, the relationship is not systematically 
explored* ^ 



C. Lyon et all Evaluation and School Districts (1978). 



Lyon et al. were interested in the existence and role of evalua- 
tion offices in LEAs. They conducted a nationwide survey of 750 LEAs 
with student populations of 10,000 or above. Among the main findings: 



• Only 43 percent of thg 750 districts had a central office 
responsible- for program evaluation, (the percentage may bfe 
increasing-with most unfits established since 1970); 

• Only 26 percent of the units 'T:hat did exist reported dcing 
all of the district' evaluation--in the rest of the cases, 
other units in the:ce,ntral office alst) 'conducte^U^aluations; 

t'Evaluation units^received about one third .of their funds 
from federal and^ state sources^ and two thirds from local 
' . ^ sources; - . ^ , . , , 

• About h^a^f'Of tfte'units dtd not spend 'any money on consul- 
tants (relying entirely op district personnel); 

• About 75 percent said that' testing student -achievement was 
the dominant activity;^ 

^here was little evidence that achievement scores or other 
Evaluation dat^^were linked to instructional improvement 
procedures; , * 

t Evaluation heads were more likely to iderfttfy additional ^ • ^ 
staff, incre^jd. access t;o computer time, and j'nformation 
about effect iver evaluation ptfactfces as- more important 
than staff development, commcTnications,- and organizational ' ^ 
changes!- \ , , - i 

Lyon et aT» alsb, foynd that only 38 percent of the ev.aluatiori 
units were located in J^he instructional division (as distinct f,rom be- 
ing located in the adfnini strati ve division, or being totally separate)*. 
Thus, 62 percent of thb units were not in the "instructional line" 
(p. 36). Of the di strict .evaluation report^ examined, only 17 percent 
described program impi ementat ion* Finally, evaluation personnel spent 
60 percent of the1r\t4nt6 with administrciti ve cl i ents* (superintendent 
board" .members, federal/state ^agencies) and some 40'percent with teac 
ers, principals, and parent groups. Time spent with/teachers/princi 
was devoted primarily^ to' Inse'rvice workshops, infoj/ming them about t 
^ministration and interpretation. * . ^ ^ 

In short, there \^s little use of external resources and limited 
intra-district coordination Qf evaluation and program improvement 
activities. 



J. Frankel et al. ^^ Peffdrmers of Research and Research-Related ' 
Activities in ,^h^ Field of -Education (1979-)" 

^Portions of tHe^re^earch ,by Frankel et al. (1979) provide some '^-v 
useful descriptive-overview 1nf,c^ation relevant to our interests 
(but, again, directly r^elated details are limited). . Frankel et al.^ 




conducted a na^iorivylde censys of or^aniiations performing edufcational 

* research, ^jevel opment , d^isse'mi nation, and evaluation. X^eir final sample 
consisted of 1 ,530 1ns|rfiaitions,9?j)'?the public, academic, and private 
sectors. The pyWic sector tntftided 37 state* education agencies, 193 

• Mntermediata^rvice agencie?, and 401 school districts (minimum enroll- 
ment: 10, QQ/)^). .The report contains some interesting comparative analy- 
ses, but I will confine my summary to some of the findings most relevant 
to local sehoQl districts: . * - 

• Of the total $734''mil lion spent on ^RDD&E in fjscil year 
1976-77, $54 million (or seyefr percent ) wa^ spent by th^ 

. local distri^iftS'in^lhe sample. • ^ 

• ,In the public sector^, over 80 percent of the funds for ' * 
'research came^from the federal (4§ "percent) 'or , state (35 

percent) levels. • > 

t About two thirds of the 401 districts spent less than 
$100,00Q'on educational RDD&E (l9^districts spent more 
than $500,000). 



One quarter of the. districts doing RDD&E ha.d no full- 
time professionals conduoti^ig those activities, aod 
* another quarter had only one full-time professional. 

Seventy percent of the districts conducted fewer- than 10 
projects during the year. 

• Projects, in the public sector, *as would be expected, con/ 
centrated/on development and evpiiuation projects as 
distinct from research. 

/rankel et »aU conclude that only a smajl number of districts 
^ ^conduct development and evaluation. proje^ts,^ and speculate that the 

use of results (to adopt, modify, -discontinue programs, etc.) is less - 
] likely vHien/la^OTl^s are not conduGt'ir>g evaluations, i.e., in situations 
where eitheK ho^ evaluation is being conducted or where' RDD&E is carried 
out by those out?ide the district. Theyj'mply that more locally based 
- projects wpuld' b^desirab]j^ (p»i'l85). Of course, the more fundamental 
question is: • Wha>t are the^'-c^acteri sties of effective district"RDD&E 
r\)jects compared to less effect ive. ones? This question of effective- 
^„^s wa^ beyon*d,the scQpe of the Vesearch by Frankel et al., but'their 
^main conclusion^-that school districts do not conduct much development 
and evaluation research— is congruent with other reseaVch findings 
(e.g. , Lyon et al. ). • ' 



*The researchers note (P|g,185) that pver one third of, school systems 
reported zero RDD&E activities, mis presumably refers to the larg^ 
sample they begaq v/ith, of which only a certain number met their erf-, 
teria. In any case, their sample was^ selected on the basis of presumed 
ifivol vemerjt in RDD&E, and, even with this select sample the activity is* 
concentrated in a sma.ller number of districts; 
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. other Studies ^ ^ 

M. Kennedy et al. The Role of Evaluation and T^t Information 
Public ScheoTs (1980). _ . • • ' . 

A. Bank. School District Management Strategies to Link Testing with 
Instructional Change J1981 \ , 

. - / ^ . U ■ U ^ ' 

D. Crandall et»al. Helping Schools Get Better: Strategies for School s 
Development in the 80s (forthcoming). 

K. S. Loi^is and S. Rosenblum. Cinking R&D with Loc/l Schools: A 
Summary of Implications for g-issemi nation and School Improve -: 
nfent Programs (1981 )" \ '* y 

There are four other>tudies relevant to local di strict improve-; 
jnent process^es to'whichfl woultMike te refer, although it wiLl not 
be. possible to^mention mote than a few highlights across the^ studi es.* 

'Kennedy et al'. (198.0) set out to identify "exemplary school dis-. 
tri.ctrs" noted. for their use, q/ test information to improve in^ructl^n. 
One hundred eleven districts were nominated, from which^the nesearcheVs 
selected 18 for closer study. Kennedy et al r stress^,two major unai>^ 
.ticipated variations in the districts: ^ ^ ^ '^y'^ 

• • ♦ *• 

1. One ^impo'rtant variation related to* "the instit^iona!- 
ization of decision-making strategies incorporating 

/available data; the pTiaictice of collection and applying 
vJ^rious kinds of data pervaded the decision-making pro- 
cess V several districts" (p. 16). Many of t-he exem- 
' plary districts systematically collectqfd and used data. 

The norm v/as to discuss issues in relatioq to research 
data. ' ' 

2. Districts varied in terms of the pn^sence or absence of 

^ major changes. One' ha]f of the distr.lct^ were experienc- ^ 
^ ing at least one major change (Strikes, reorganization, 
desegregation, crises v/ith superintendents). Major 
changes unconnected with the program wSfre fairly "nomaT" 
and affected whether and how information could be usea. 



*My brief comments merely introdtice these other studjess ^ The original 
reports should 'be examined directly. * 



At the district level,. four program themes recurred (p. 47 ff.):^ 

1* Authority ♦ District program directors frequently said 
that they lacked sufficient authority to supervise pro- 
grams for which they were responsible. 
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Compliance . * Pr^)gram directors were frequentl^y occupied 
by providing compliance data to external agencies (state, 
federal), witfi little time for interacting with use^ and 
focusing on program improvement/ (See Elmore [1980] for a 
disofu^ssion oj^ compliance versus capacity.) 

•unding . Program directors were frequently preoccupied* ^ 
with establishing and maintaining funding, and with' stav- 
ing off budget cuts Including complete elimination of 
their programs. (This was especially true for projects 
that depended on external funds, but was also the case for 
those involved in competition within the district for 
local funds. ) . ^ • ' - 



4. 
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rogram improvement . 'In 10 of the 18 districts, program^ 
directors gave ^.everal illustrations of how they used 
dat? to bring aboul program improvement. 



At the school build? fig level, twtT issues in particular emerged 
from the Kenne)Jy ^tu'dy. First, ^in nine dislUricts, school staff indi- 
'cated that implementation , of 'district policies was'a major problem 
(p*. 67), especially because of ambiguity in the policies and/or diffi- 
culties in providing requested data. ' (In this case, greater emphasis 
on data without corresponding assistance created maiiy more problems 
than it solved. Concerning "e^tejnal use>" it is also important to . 
note that in^this equation, the districtf off ice is the external 
agency and tie school ^the interna rone. ) Kennedy ilso found that at 
the buildi n"^' level , few interviewees had any data'Jt all on building- 
level issues, and hence few used^^ata to resolve problems (p».129).^ 
(See Neumann's [1981] parallel paper which provides some examples 
effective use of data by school principals.)^ ^ 

Lastlfy, as in the Lyon research, .Kennedy and her colleagues fpund 
very great variations in the kinds of information gathered and in the 
way in which districts were organized.' Qne urban district had fiv^ 
evaluators, another slightly smaller district had over 100; one dis- 
trict depended entirely on federal money for its evaluation budget, 
another foe only five percent; some evaluation units designed most of 
their products for use by the central* of'fice, while others saw teachers 
and principals as their primary clients. ^ ^ 

In^a follow-up to the Lyon survey. Bank (1981) conducted extensive 
field work in six school, districts selected because of their reputation 
for linking testing or evaluation activities with instruction. Some 
familiar findings; " \ 
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^ \ six distncts were "in the nricfst of \Mm\t ^nd (5rob- t 

lems" (p.\*), e.g., desegregation orders, Iqrge popula- 
tion shifts,' new immigrants with' languages other than ' 
o English.^ * ' • ^ ^ ' ' 

/ • iH foun of the six-dl.stricts, testing programs had be^n 
developed in response to federal or state funding. 

- ^^I'Three cohditions were present to varying degrees in 
^ all cases. Bank refers to these conditions as the 
' V : sine qua non of data-based instructional change strate-^ 
-•^ ^ ^ gies; (1) motivation or the presence of "a strong incen- . , 
tive to make> itnprovements (e.g.*, frustration apd concern 
about low achievement; board policies, parent pressure,, 
^federal or state requirements, or other external pres- 
, sures to change); (2) t'he presence of idea champions--a 
small grouft of key people in. the district who cared and 
persisted in advocating the use- of test information* to 
imprdve instruction^^and (3) a coordinated delivery sys- 
tem--instead of autonomous units with little interaction, 
the six districts evidenced coordination ?and interaction 
among divTsTi>os, unij:s, and schools in the colleU^ion and' 
use of testincft informaftion. ^he districts ranged 'in the 1 
formality v^ersJs informality o^the co^inating system, 
but al? s^xd^tricts wehe cha/^cteriz.ed by frequent 
interattion^d flow of communication and information.* 

^ ••'Sank discovered three orfferent management apprpaches 

V«^^ to-connectiQaj^i^kting ami instruction: a personnel 

or staff devYlopitient strategy (two districts)-; (2) a ^ - , - 
building-levi^^problem-sdl viW (two districts); 

and (3) an ins^ctional ly oriknted objectives-based 
strategy*. ^Banklrstes that some districts used mixed 
. approaches, but that most had a fairly coherent* primary 
strategy. 

The finaiJuvo references (Crandal.l et al., Louis and Rosenblum) 
represent an important shift in relation to most of the'above studies, 
because, they focus on the broader topic of innovations and school im- 

^ provement rather than on the role of evaluation. Crandall et al. are 
ju$t. completing a large-scale. ^study of Dissemination Efforts Supportb' 

* ing School Improvement (DESSI)\ Among other things,* they have investi- 
gated the adoption, imp]ementation, and impact' of National Diffusion 
Network progr-atns. Title IV-^, Bureau of Education handicapped programs,' 
and state education i nnovatTv^*R£Ojects. They jcarried out surveys as 
well as 12 case studies, and were able to^"triangulate" and cross- 

' compare many, of their findings. Their study js comp-rehensive and 



*Note that it is the three conditions in cofiibinatipn that are important. 
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detajlecj, in analyzing' the processes of improvameni; fr^ adoption through 
imp-l^mentation^and inipatje-,';and jn studying intjra- and'iriter-level 
relationships at ttie cJassroom/schooV,- di strict , slite^.a^nd federal 
'levels. 'The ftaal f'eport^^ad full findings^are not yer?^, available, 
and the study is in any case much tod comprehensive to discuss in«any 
detail in this paper. Suffice it to say that the s-tul^ deals exten- * 
siveTy with 'hov/ and why school districts ado'pt new programs, and with 
the"^ variotta kinds of internal (district) and external ^support and., ^ 
technical assistance necessary for implementatioa.,^ * - 

<*• 

The* study clociwient^ sevw^aV type^s of sibcessful outcomes. The find^ 
ings are consistent wftfh the research'discussed -.in this. paper, but are 
much more specific and e;<planatpi^y^.a5~Te-gards^tlTe eVents.^nd processes 
of educational change (se^^also Fullan, 1982)'. .More to the point., the 
DESSIt, research demonstrates that there are useful 'programs^ information, 
and technical assistance externally available for school districts; that^ 
effective use depends on a combination of factors related to certain 
school and school district capacities interacting with external resources 
and that when these external resources^and internal orientations and ca- 
pacities are combined, positive school improvement outcomes occur. The 
DESSI study, in. short, is 'the most direct research examination of , the l 
factors related to the topic.qf this paper.. (I refer to it again in 
Sections II and III, but a systemattc^'tnterpretation must await the ar- 
rival of the full report.) ^''^ — 

A second valuable, large-scaVe study which has become av.ailable 
in the last s?x months is the research evaluation of the R&D Utiliza- 
tion (RDU) Program (Louis arnd Rosenblum, 1981a, 1981b). The RDU research 
is important because it addresses multiple aspects of resource support 
(incfuding both product and process support) and improvement outcomes 
(use of new products,, incVeas^d problem-solving capacities)." It is also 
a well-designed jsnd -documented, piece of -research. *(See Louis and Rosen- 
blum^ Jil981a]. fofr an overVl^ew of the project fitrdlngs and reports;) 

The overa\l objective of the RDU Program was to help schools clarify 
And solve local\roblems through the use of external resources (pro^cts' 
and technical assistance). Seven^major projects weVe supported by 
RDU Program (The Northwest^ Readi ng^ Consort ium, the NEA Inservice^ f duca- 
tion Project, The Consortium of the J:^tv/orki Inc.,. and four proj-ects 
operated by the state education agencies^f Georgia, Pennsylvania, Flor- 
ida, and Michigan). More than 300 schools participatecl lin the program, 
which was funded for a three-year period. 

JOnly a. few of the b^sic finding^ will be listed here: 

1/ Approximately 75'^percent of the schools successfully 
adopted and implemented new*programs and' practices; ' 
externally developed products were found to be very 
relevant to the needs of schools.' 

*2. External human assistance was found to be very ^ v " 

/ important, if characterized by intensity (frequent ^ 
^ interaction), initiation as well as responsiveness. 
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and the i;ivolveme?^l of a variety of external agents 
rather than only one., ♦ 

3.' Internal pr/)blem-sol ving activities weTe important if 
the following elements were included: an emphasis on 
building consens^js and "ovj^nership" ti;jrough. communication 
""with teachers not on the teaig; ^ strongly-. Committed team 
pleader; explicit attention to planning and_1mplementation; 
and 'strong but tactful intervention by^the^field agent,, 
,who could' connec3t th^ schools with necessary resources. 
A small amount of external funds. ($1 ,000-$8, 000 per < 
site) was used at each site, primarily to provide re- 
lease time for teachers on problem-solving teams,. ^ 

> 

Louis and Rosenblum draw several [conclusions. First, the com- 
bination of technological and pepple/process support is crucial; it 
is important to provide- support for hfgh levels of effort and broad--^ 
inyaivenient in a problem- sol ving process designed to'decide on and- 
im^ement new programs and practices* As to the RDU Progranr' s twin 
goa.ls pertaining to new product use ^and increased ^problem-sol vi ng 
capacity, the researchers found relatiively high degrees of success 
in tbe former but much less Evidence 6f success in the'latter. 
Three years was insufficient to incorporate prob^lem solving that 
linked intra-school processes with external resources. , . , 

Let us^ov/, turn to a more analytical treatment of the studies. 
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Section 2^ ^' Cross-Study Comparison 



In the four main stadies6:eviewed, the major variables of interest 
are not isolated -and examined directly, so a formal systematic compari- 
son is not possible* llF facilitate some cross-study compaw'son, I have 
organized thts^^Ssection into two parts*-; The first presents' a^ simple 

' ■ ' Several 

nS"th( 
r- i n which 



analytical frafliework for considering some findings across 
studies. The secohd part 'lists some dilemmas, gaps, and \unknownS"the 
latter providing'a link to tjtie concluding section of the pagg 
some policy/reseafrc^i agenda recommendations are made* ' 



FramgwoVk arid Findings 



r 



Figure 2 represents .an overview of 
ces'S in relation to external resources, 
improvement outcomes* 



the elements' of 
school district 



the change* pro- 
factors, and 
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Figure 2* Elements in the external resource/ 
school district improvement process 



Internal 
School District Factors* 



External Resources 



Commitment of leaders.hip 
to improvement 

Explfcit coordination 
and problem solving at 
district and school levels 

Staff ' development' of ad- 
ministrators and teachers 

Evaluatio~n/data gathering 
linked to use for improve- 
ment 



Crisis events 



Phases of the Change Process 



Adoption 



Funding 



Information/ 
programs " 



Technical • 
assistance/ 
staff devel- 
opment 



Implementation 



Funding 



Information/ 
programs ^ 



Technical 
assistance/ 
staff devel- 
opment 



Outcomes 



Fuadi ng 



Information/ 
programs ^ 



Technical 
assistance/ 
staff devel- 
opment 
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The logic and main concepts of Figure 2 r,equire som^ comment. 
First,, external resources are classified according to three types: 
money,' information or programs, and -technical assistance. This divi- 
sion closely parallels Louis and Rosenblum's^ threefold classification 
of resource support in terms of fiscal strategies,' technological 
strategies (information, materials, products,) and process/people - 
strategies. Thus, school districts' use of external resources can ^ 
be conceived of yas involving none,* one, two, or 'all three types of 
resource support. , 

Second^, there are different phases of the change process. Dis- 
tricts are sometimes exploring, considering, or making decisions about 
nev^^'directions or programs; "a'doption" refe^rs to what- happens leading " 
up to the first use of new ideas in pra.ctice. "Implementation" consists 
of all those events and activities designed to support actual use of ) 
ideas from the time of first attempted use until the new ideas or prac- 
tices are routini.zed or rejected--a period nearly always covering more 
than 'one school year. "JDutcomes" refers to a variety of consequences 
resulting from the implementation phase. Crajidal 1 et al. (forthcomilig) 
identified and assessed five types of outcomes:, de'gree of implementa- 
tion of a new practice; attitude towar^i^the practice; impact on students, 
teachers', and" the organization; 'instiuiional izati.on; anckattitude toward 
school improvement.* Louis and RosenbTum (1981a, p.*149) identified a 
sofliewhatNsimi lar set of six outcome*: organizational change, scope of 
implementation, incorporation of the product, incorporation of a problem- 
solvi'ng process, problem'resolution, and personal impacts. Note that 
the three types jDf external Resources may (or may not) be available. 
Or used (to support and/or assess what is happening) at each of the 
three phases of the ^harjge process. ' ^ ^ 

Third, characteristics of the district determine to a great extent 
whether and how the district combines external resources with liiternal 
resources and procedures. Indeed, these characteristics are so'power- 
ful that if they tend strongly in the negative direction, no amount of 
external resources is likely to result in significant improvement; and 
if they tend strongly in the positi ve^directio^i^ ^districts can bring 
about major improvements i^ the absence of sigrfi^cant outside support. • 
In between these'two extremes, the right combination of^e>jternal re- 
sources can help districts to bring about posit^^- change, \/id in many 
circumstances small amounts of external resources' ca^n make a critical 
difference. Whatever the situation, the characteristics of the district 
represent very important variables v/hich heavily* influence external 
use* j'nternal procedures, and consequently school improvement outcomes. 

Using this framework as a point of departure, whajt are the main 
findings from^the studies in Section 1? These main findings, "with cor- 
responding references, can be summarized as follows (organized under 
the three categories): ^ • \ 

External Resources , ' ■ \. 

1. External funding does play a major role in providing 
^ resources for program innovation, evaluation, and other 

^ \ ■ ' 
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improvement-re Tated ac^^vlties. Six of the elgjjt 
studies--Adams and iVon* being the exceptions--indi< 
cate the presence of major external resources. 



2. There, is some indication that i nformatj on/program 
resources combined with technical assistance/staff 
development re'sources are necessary for improvement ^ 
to 'occur (Crandall et al., Louis and Rosenblum); 

stated differently, one type of resource without the 
^tJier may not' have much impact.* Inclusion of the 
third resource--fund.S"by itself does not mean much, 
unless the funds are used to purchase program and ^ 
"technical help. 

LEAs ; ^ * ' ' : ^ 

3. Although there are no thorough studies of use*of ex- 
ternal resources, there is considerable evidence in , 
our studies that most districts do not carry out 
systematic program planning, -^implementation, evalua- 
tion, etc., eft her through the use of local resources 

or through obtaining external resources to support 
these activities (Lyon, ^nnedy , f rankel ). 

4. The smaller proportion of districts that are success- 
ful ("exemplary".) possess-"^ some common properties:, 
^commitment of top leaders and other key advocates; 

an e)^plicit coordinated delivery system or plan for 
problem solving, collecting and usijjg , information, 
/etc., to bring about improvement; staff development 
and other forms of technical* assistance-end support 
fr^ both internal*and external consultants; .proce- ^ 
dures for using program information and other evalua- i 
tive data; crisis events as common occurences which 
either generate pressure for improvement (incentives) 
or interfere with plans for improvement by diverting 
.energy and attention (Bank, Kennedy, Crandall , J-uis 
and Rosenblum).* 

5. Despite some common general properties, variations* and 

f^t^ueness in condition^ and approaches to improvement 
n-'aiDpng apparently equally successful LEAs were obvi- 
: 'presence or absence of evaluation or other similar 
units; differences in how central Offices were set up, 
independent of size of the district; differences in how* 



*Se6.also Ful.lan (1982) Chapter 10, for a review of^the role of dis- 
tricts in educational change; and our case study of Adams's district 
(Fullan et al., 1978), which takes' a thorough and systematic approach 
to using ^xterwl resources (prograrns, consultants) for training in- 
side teachers and administrators. " 
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explicit the object ivg^- were, and in how formal the 
pr<jcedures were; differences in primary strategies * 
(di'Strict-wide staff development versus school-based 
problem solving versus district-wide instructionally 
oriented object ives-ba^sed approaches); differences in 
orientation of district evaluators or data gatherers 
toward externaT agencies versus central office staff 
versus school-based staff; and the presence or absence 
and differences in types of crises faced by districts — 
nine of 18 districts in Kennedy/s study and six of six' ) 
. ' in the Bank study were facing major crises of different 
kiJids' (Al k'in, Bank, Kennedy, Crandall , Louis and Rosen- 
blum).- 

Outcomes ' . ; * 

6. Except for the CrandalT study and the Louis and Rosen- 
blum study, little has been done to relate' external and 
district factors- to school improvement oiKtcomes. These^->^ 
two studies discovered high percentage? oKeuccess. 
(Several factors should be kept in mind: Success was 
related to the presence of external assistance combined 
with certain LEA and school characteristics as 1ndi- . 
cited ^above; the two §!ludies focused on .the population 
. of districts/school s "that had selected external innova- 
tions, ^nd therefore were working with select sample?.) 
The conceptualization and measurement of different types 
of outcomes are major contributions of these .studies* 
As for the other six studies, there is either no discus- 
sion of outcomes (Adams, Alkin, Lyoa, Frankel) or else i 
^ there' is a discussion of positive outcomes but without 
any formal attempt to represent the outcomes (Bank, 
Kennedy). 

Dilemmas, Q^^stions, and Gaps 

1. We know very little about how LEAs interact with outside 
agencies (in relation to the three types of external re- 
sources--fitels, information, technical assistance)* Some 
studies h^^^ focused on, particular products cm^ programs 
but not omthe array of information and products* avait-, , 
able. 

V " - 

• a 

2. There is no clear distinction of clients in the LEA, es-, 
pecially central office versus school personnel. In 
most studies of external resources, we do not g^t ^ 
Clear differentiation of whether e^ich of these two types 
of clients benefited or not frpm access to and use of 
external resources. We also need to examine the external/ ^ 
internal relationship within the LEA' between centra>^Dffr 
ice and school respectively. (Crandall et al. and^t^is 
and Rosenblum address this question.) ^ 
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3, Is tt -better for LEAs to concentrate on adopting spe- 
cific external programs or ^o attempt to -maximize the 
r range of information flowing into the district? Weiss 

(1979), for example, stresses the incrementa.] enlighten- 
ment function of knowledge as distinct from.lts spe- 
fejfic problem-sol ving role. 

.4.' Is it bettetr- to 'attempt district-wide coordination and 
program implementation, or to support ind'ividual-adiool- 
based development? > ^ 

« 

^. Is it better to have 'tightly coupled, formal integration 
and procedures or more^ informal interaction and coordina- 
tion? 

" -> * . 

6. What ,is the best combination of external and internal re- 
ssources in terms o'^-de^l oping the LEA*s capacity (knowl- 
*edge, skil Is) to bring about school improvement? 

7. What are the relative roles of and relationships between 
evaluation and innovation? (Four pf the eijht studies 
examined the role of evaluation, while the other four 

, involved research or innovation studies.) 

-There aVe more unanswered questions that could be, generated, btit 
perhaps the above list is sufficient for drawing some conclusions about 
future research priorities in the area. 
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Section 3> Research Agenda Implications 



The del^nitions of the three main concepts presented in Figure;! — 
external resources, LEA characteristics, and improvement outcomQS--are 

-not entirely refined, but as a context for future research- they offer 
some basic guidelines. External resources .can be defined in terms of 

^money, information/programs, and technical assistance. In this paper, 

• the ^operational definitions of- rEA characteristics , especially demo- 
graphic ores, .are incomplete^ the geheral list in Figure 1 summarizes 

^some '^^i* the main LEA characteristics. Crandall et al; and Louis and 
Rosenblum have contributed much-needed conceptualization and measure- 
ment of improvement outcomes . 

There are four types of studies that I would place on the research 
agenda. ij 

f " 

-1. Deta-^lejd/tTase Studies of LEAs^ Use of External 'Resources and Related 
^ Intern/n Processes > 




By Jan the most important research priority is. to discover what 
the use of Internal resources looks like from the point of view of LEAs 
(district and school level included"). Taking LEAs as entities, we sim- 
ply do not know very much about how they think about external resources, 
how they go about obtaining them, and how they use 'them. There are ' 
studj-w^'that have examined particular programs (e.g.. Title I, NDN),'but 
thes^ only address segmented use of certain external programs; they do 
not attempt to capture the totality of LEA involvement with-external . 
resources. (For example, these studies^ tend to examine the* impact of 
^particular' programs on a district--a kind of outside-in orientation, 
as distinct from the 'inside-looking-out orientation I am suggesting.) ^ 
Thusi my first recommendation is that a small number of very compre- 
hensive comparative case studies be undertaken with the explicit 
mandate- to identify types^of external resources ,^to carry out a care- 
ful. study of external-internal relationships and internal-internal 
relationships around the use of external resources, and to assess., 
multiple. impacts or consquences. 

' Jwo recent' effort^ might contribute very useful research designs 
and methodologies to such ca\e studies. Moor^ ,and Hyde' (198,1), focus- 
ing" on staff development, 'conducted a first-rate .study of all aspects 
of LEA activity in thrfee urban districts. They discovered many comr 
plexities, hidden costs, and unrecognized staff development activities. 
For example, they found 50 times more stajff development going ori than 
district staff developers estimated.' Moore and Hyde did a masterful ^ 
job of identifying different types of activities and calculating vari- 
ous direct and indirect costs. I suspect that a sturfy of the use of 
external resources in LEAs would uncover similar'complexities "and 
hidden uses, and would make a^'major contribution to this topic. The 
case studies should in particular use fiscal costs (direct and indi- 
rect) as a driving indicator, because this would provide mot?e specific 
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information about the use of resources. This strategy is>lso condu- 
cive to the identif ication.of concrete activities rather than amorphous 
generalizations, 

A second model with important empirical and methodol.ogical impli- 
cations for us is the DESSI case study research of 12 districts. The . 
cross-site comparison and synthesis of the case studies is especially , 
useful in suggesting how multiple comparisons can be fruitfully made 
^and displayed. (See Crandall et al. Miles and Huberman have been" 
primarily responsible for coordinating much of tfrts research, arid have^ 
a separate gr^ant to^ do->further work' on the ca'^se study compar*is^ons; 
but bear in mind that^ej^r studies were not designed to do what I am 
suggesting here.) ^ ^/ ^ 

'In brief, I recommend a small number of case studies (something 
on the order of three to six) that comprehensively examine the external 
resource use question by taking the LEA as an entity.* 

2. Survey or Mini-Case Studies of How LEAs Are Organized for External 
Resource Use 

ATI; of the studies that have something to say about how LEAs 'are 
organized (central office units, district-school relationships, etc.) 
comment on the incredible diversity of set-ups even among LEAs of 
comparable s'ize. None of these studies, however, was exclusively 'ifiter- 
e^ted ^in external resource use; most concentrated on the role of .evalua- 
tion information. It would seem worthwhile to conduct a survey or 
series of mini-case studies of a larger number of LEAs (larger than* the 
case studies would permit) to investigate how the districts^ are organ- 
ized and what consequences this organizatiorjxhas for external/district 
^office relationships^ district office/scho^ relationships, and external/ 
school relationships. It is important that this be more than an examina- 
tion of the formal 'organizational charts. The study should ask questions 
about the interrelationships.. flowing from the Vay in which the district 
is organized.- Of course, the intensive case studies proposed in item 1 
V/ould consider Tfcese questions, but only for a very small number of 
districts. The survey/mini-case studies would include a much larger* 
sample (perhaps 50 districts sftlpcted to represent 'di fferent sizes and 
geographical locations). . * 

3. A Survey of 'LEA Access to and Use of External Agencies **^ 

* * • ^ . ''ft 

It may be that this^ study could be incorporated into the second 

* I have not attempted to summarize th^ main variables that shouTtd be ex- 
amined, in the case studies,' but most can be culled from Sectior\s I and 
JI and from consulting the Moore, and Hyde and DESSI designs. 

** The.NIR InterorganizationaT Arrangements (lOA) research program is ad- 
dressing this issue, though possibly without adequate attention to the 
question of variations in access. ^ I 
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recommendation. We want to knov/ about "various types and degrees of 
acceS'S that [.EAs :have to external , agencies that provide one or more 
of the three Jorms. of resource assisjtance (funds, information, tech- 
nical assistance,).^ ^Gfven the arrsiy of different external agencies 
(state departments, intermediate agencies, labs and centers, universi 

,ties, etc.), the Research question shoxild .properly be phrased: "What 
access to'ext^^^aT agencies do different LEAs have ^iid what ^use of* 
them do they rr^^ke, and to what extent are these factors related to 
the location of the LEA|^ Proximity to external sources and the par- 
ticular configuration an^ro.le of agencies in the accessible environ- 

lament of the LEA wou'l<J be two' important variables to study. For this 
research, a larger-scale survey (N=500 or more) should be used. 

4. Additional Synthesis of Selected New Research 

The mafn message of our present review" is: There are few direct 
studies 'Of LEA use of external resources. However, it also seems 'to 
be the case\that' more recent research (cited as our secondary sources 
Kennedy, Bank ,.'Cranclal 1 , Louis and Rosenblum) has more to say about 
LEAs and ex^feernal resources than do our four primary source^. Since 
sqme of this research has just been released--or is not yet available 
and since a. more careful search may identify some additional sources 
of direct relevance, consideration should be given to a review and 
synthesis otHhis-^ore recent work. Such a synthesis should attempt 
a more formal specification of variables within each category, using 
the present review as a guideline. ^ 
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I'nt reduction 



This knowledge- synthesis covers a number of studies that address, , 
* at least 1n part, the role of SCDEs (schools, colleges, and departments 
of education w1th1n Institutions of higher education)^ In the pursuit of 
school improvement. These studies emplm^ed only four Independent data 
sources. - ^ ' • * 

{ 1. The Clark-Guba study of SCDEs,_ which was rea,nalyzed 

subsequently by Lotto-Xlark concentrating on knov/ledge 
drssemi nation and utilization. 

2. The Frankel-Sharp-Blderman study ^of research performers 
In -education. Including SCDEs. ' ^ 

m 

3. The Haveloc^et al. case studies of three Interorganlza- 
tlonal arrangements (lOAs) 11 nkl ng colleges of education 
and school districts. 

4. * TherTDR Associates case studies of three lOAs In Boston, . 

Involving universities and school" sub-districts. 

- The power of cross-caSe analysis Is llntlted here by the small jmuu 
ber of. data sources and the variability 'of thpsfe sources. in the areas 
, of methodology; organizational .focus, and Substantive concentration. 
Consequently,_in Section I thjis report will,p]ace greater emphasis on 
summarizing#the individual papers than might otherwise have been called 
for. The cross-case comparison in Section II will be organized around 
a central table picturing the extent to which the studies cover similar 
?Hbstantive areas and variables. Data from the studies will then be 
used to Address sik questions of special interest to policymakers con- 
cerned with school improvement programs and initiatives: 

1. What -is the scope of "SCDE involvement in school .improve- 
ment activities? . * 

2. What organizationaT'chaf^cteri sties seem to influence the 
scope or effectiveness of that invblvement? 

-^3. What incentives or disincentives exist that influence 

- . the participation of SCDEs in school improvement?, 

«> • . ' 

4. What funding sources are used to support these efforts? 

5. How can SCDE acti\^ty in school improvement b%st be 
described (e.g., in terms of clients, types df services, 

• organizationar arrangements to support the serv.ices)? 
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6. What is the perceived and/or actual level of effectiveness of- 
, \ these school improvement activities? 

Finally, in Section III, implications will be drawn from this .data base 
» for further research in the field and for federal/state support of field- 
based school improveinent pirograrns that involve SCDEs.' 

The reader should not be misled by the foregoing reflections on 
the narrowness ©f the knowledge base into assuming that this base was 
treated casually. Each of the eight available documents was content- 
analyzed using the following framework: 

J- _ . ■ 

Figure 1. Structure for analyzing literature on the 
role of SCDEs in school improvement. 



t Context 



Organizational characteristics 

Incentives 

Funding sources 



t Operations 



Scope- 
Clients » 
Type of service 

Interorganizational arrangements 



SCDE poten- 
tialities and 
limitations 
in school 
improvement 



f Effectiveness 



Implications for' 

• Policy 

• Research 



Actual 
Perceived. 



Every entry germar>e to these topical areas was identified, coded, an^ 
recorded. To the extent possible, the flavor of the studfes has been 
retained in the summaries and analyses. 
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Section K Summaries of\ive Studtes on the Role of 
Schools of Education 1n Schoo] Improvement 

' u ' ' ■ ■ ■ 

D.L./Ufark and E. G. Guba. A Study of Teacher Education Institutions 
as Innovators, Knowledge Producers, and Change Agencies •('1977). 

Background/Scope v •^ 

. This national study of schopls, colleges! and departments of educa- 
tion (SCDEs)\included in its examination of institutional productivity 
in research arid knowledge utilization the tOtal population of 1,367 
SCDEs; a sample of 135 institutional respondents and 1,387 faculty re- 
spondents who were queried^ about institutional missions, arrangements, 
and programs in RSD and knowledge uttlization; and 20 in-depth case 
studies of schools of education chosen on 'the basis of typicality and 
uniqueness after the normative survey phase,, of the inquiry was completed^ 

The purposes of the inquiry were to: (1) portray the status of 
SCDEs as components of the nation *s -educational knowledge production and 
utilization (KPU) system; (2) identify internal and extQ^n'al factors af- 
fecting that statusj and (3) posit most lil^.ely and alternative futures 
of schools of education in KPU. 

a 

The focus of the entire study is pertinent to the current pap6r. 
The limitations of the data from this study spring from the inability of 
the researchers to identify school improvement (knowledge utilization) 
activity as distinct from R&D. In the case- of R&D, much of the activity 
occurs on-campus or through very 'visible arpangeme^nts with local educa- 
-tional agencies. And, more importantly, th^ product--typically a 
p'ublication'--is easily accessible for examination. School improvement 
activities, however, are .often not institutionally spoasored; they are 
frequently af limited duration (e.g., two-. "or three-day cons'ultancies) ; 
.and their products are typically difficult to trace and assess. This 
project was well geared to handle KP (knowledge production) activity; 
but poorly designed to identify KU (knowledge utilization) projects or 
outcomes. - ' : , 



Context 

^ Organizational characteristics. This study identifies two catego- 
ries of organizational characteristics that influence the involvement of 
schools of education in school improvement :i census-like demographic 
features and contextual qualities that influence institutional behaviors. 

Regaling the "census" features, the researchers note^ v ' 
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• Personnel in SCDBs are. highly trained and experienced-- 
the model faculty member has the doctorate. and five to 
10 years of puJblic school experience. 

W SCDEs are everywhere; there are 1 ,367 'such units. Seventy- 
two percent of all four-year institutions of higher educa- 
tfon (IHEs) maintain a teacher training program, 

• However, regarding KPU activities, the institutions are 
easily divided into "haves" and "have-nots," KPU activity 
is concentrated in units with advanced degree programs, - 
roughly one half of the institutional population. 

These institutions do have a quality of orga/iizational life that 
influences the activities their members undertake: 

• 'The organizational culture is primarily ideographic^Jhe 
role of the professor as private entrepreneur (circa 20 
percent time) is legitimated in IHEs, 

« * 

' • The organizational mission of SCDEs is to train educational 
^personnel, "Missions involving the SCDE in KPU activities 
*must be considered compl emeijt a ry rather than integral to the 
SCDE in all but a. few such sites (perhaps 50-60 of 1 ,367)" 
'(p- VII-10), ' . 

•School improvement (KU) missions (and, to a lesser extent, 
activities) are concentrated in public rather than private 
SCDEs. 



• SCDEs are low-status units |n IHEs. 



) 



4 Professors have limited KPU training, little supervision, 
and minimal retrainyig possibilities. 

Irigfenti veg . The coin of the realm for promotion, tenure, and 
salary" rewards in graduate-level SCDEs is research productivity. School 
improvement projects are typically rated as service contributions and 
have rower priority than either research or £eaching. , "Promotion and 
tenurg\riteria. are applied differentially so tRat 'workmanlike' per- 
forma(;ice\n traditional, high-status areas [e.g., R&D] is sufficient, 
but 'supe\^ performance ik required in emergent and low-status areas 
^[e.g., scho\!U4mprovemefit]" (p. VII-,29). On the positive side of the 
ledger, professorial personnel are provided -^with released time to en- 
gage in KPU programs, and individual consultative relationships betv/een 
professors and locSl education agencies (LEAs), is permitted. 

Funding sources . Released time for faculty and the support. of 
special bureaus or institutes for 'KPU are characteristic of graduate- 
level SCDEs. Roughly $23 million to $25 million supporting 1,000 FTE 
faculty was invested in these bureaus and institutes in the mid-sevenT 
ties. At the time, that constituted approximately three percent of the 
faculty ia SCDEs. 
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Operations 

' Mos^t SCDEs are engaged in KU activities through the personal in- 
volvement of their faculties if not through institutional conmiitment. 
Seventy percent of faculty respondents reported that they worked with 
LEAs rendering ad hoc services. The inability of this- study to dis- 
tinguish between KP and KU activities reduced reports on "operations J' 
,i Since the Lotto-Clark study attempts to t>ease'out the data that applied 
specifically to KU, this section will be expanded in that summary. 

Effectiveness 

Clark and Guba focus on KPU products visible at a national level. 
,SCDE contributions to knowledge utilization at this leVel were substan- 
tial: • • / 

• Fifty-nine percent of the articles pub^lished in practitioner 
y journals come from IHEs; 90 percent of those from SCDEs. 

• Universities dominated the production of books in education ' 
(82.5 percent) and -textbooks (72.1 percent). 

• Presentations at practitioner conferences were dominated by 
SCDEs (35.6 percent) and LEAs (34.8 percent). / 

No qualitative assessments of SCDE programs/in KU or school improve 
ment were reported in this study, other than those implied by the accept 
ance of KU products by journals, publishers, and convention monitors* 

Policy/Research Recommendatiohs 

The authors review the capacity of SCDEs. in KPU and conclude that 
the levels of organizational and indivickial capacities „apd i nstitutional 
commitment were high enough to justify the following t^^ik recommenda- 
tions: 

1. To sustain the research and development productivity of 
SCDEs currently functioning as "KPU Center" i-nstitutions. 

2. To expand modestly ^th^* number of SCDEs 'prroducing at the 
'^KPU Center"- level. t • 

3. To expand the role of. SCDEs in the federal government's 
^ dissemination in- education program (KU). (p. IX-35) 

With a focus on (3) above, they suggest: ;\ ^ 

a. . KU capacity-building grants- coordinated with the capacfty-? ^ 
building grant program already begun with SEAs and/or the - 
new teachqr center program. These grants might well include 
a' local matching feature which could be met by most doctoral 
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public SCDEs through their current budget allocations to KU 
but which would force most masters public SCDEs to support 
their KU mission with added local contributions. 

b. Training grants for. students anoprtactitioners interestei'd 
in building up their expertise in KU activities, perhaps 
tied into teacher center programs or at least using such 
ceaters as field sites for internships. 

.c.^ Programmatic sonport of some operating KU centers, e.g., 
school , study coiKjcils, networks or leagues of schools, 
in which the, present level of effective dissemination 
activity justifies\the investment, (p^. IX-37) / 



L. S. Lotto and D. L. Clark. An Assessment ^of Current and Potential 



Capacity of Schools of Education with Recommendations for Federal 
Support Strategies (1978). 

Background/Scope " 

The purpose of this study was to portray the current effort in kO 
being maote by schools of education and to project effective^ federal 
policies to optimize that effort. The population studied was made up^ 
of 671 SCDEs- offering at least a masters degree in education. A sample, 
of 92 schools v/as chosen from this' population. The data had been gath- 
ered in the Clark and Guba study and included institut/ional and facul- 
ty questionnaires from the 92 SCDEs, case study, nota/ from l47"^nd 
secondary source data o^ productivity from the entire population of 671. 
Although no new data were gathered in this 'study, some of the data v/ere 
"new" in the sense that they had not been analyzed in the Clark and Guba 
study (e.g., open-endecl responses from the institutional and faculty 
'^questipnnaires and documents gathered during the case study visits). 
Other data appear to be new because* a conscious effort was made at every 
step of the analysis to distinguish KU from KP involvements. However, 
weaknesses in the original data-gathering design still caused many of 
the school improvement efforts -of SCDEs to.be overlooked. * . 



Context . ' ' . 

Organizational cf^aracteri sties". Demographic features and contex- 
tual qualities that were noted in the Clark and Guba report will not be 
'repeated. The following observations focus on KU or school improvement. 

•\ 

§ Twenty-eight percent (T82) of the SCDEs stated a positive 
-Organizational mission in dissemination and utilization 
(D&U). Another 20 cpercent had mission statements that ' 
would be complementary to D&U involvement. 
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Knowledge utilization activity had a broader base, of SCDE 
involvement than did R&Dt "In contrast with their low- 
involvement in R&D activity, the masters public jjchool df 
education is a rich resource of talent and institutional 
support in educational D&U" (p. 33). 



• The status of $lEpEs within their iM^i versities was not en- 

^ hanced by their engagement in^^soho^ol improvefKient activities. 

• Participation- 0^ SCDE faculty in D&U programs is limited by 
(a) the professor as entrepreneur, (b) the professor<:as 
specialist, (c) the tenured ^curity of the professor, and 
(d) the upiversity^s collegial governance pattern. 

Incentives. Added observations about the effect of incentives _pn 
SCDE faculty participation in school improvement include: 

• The emphasis on research in the IHE reward system is -not 
'adverse to involvement in school improvement. "In orrly 

87 SCDEs did it appear that faculty involvement in D&U 
would be in conflict with the formal system" (pp.' 1^4). 
In contrast, 194 noted that it was consistently o1 
portance. 



Masters7level institutions have the least difficulty in 
incorporating D&U into their reward systems. 

"Freedom of individual choice on the part of professors 
in SCDEs increases flexibility in response but impedes 
institutional commitment to goal and activity areas'V* — 
' ^ (P- 36). 

• SCDEs have an advantage over competing .educational agen- 
cies in responding to new program areas because of the 
SCDE tradition of faculty^ released time for non-teaching 
activities. 

Funding sources. Little fiscal data were gathered in the Clark and 
•Guba study; but bureaus, institutes, and centers were queried about 
their sources of support. Surprisingly, Tew of the 551 organizational ' 
entities that had been set up to attain KU goals appeared to be either 
outgrowths of or dependent on federal or foundation doTT^rrs.* 

# * 

Operations ^ 

Schools of education reported Substantial operpional commit;nent - 
to school improvement. Three hundred seventy-two Si^DEs (55 |tfercent of 
the population) maintained at least one formal 'dissemination or util- 
ization structure (e.g^/i' school study council, bureau of field services) 
In all, the population was estimated to be operating 551 such centers. 
The authors classified the populatlfon of schools of education as 



including 90 D&U cen^rs, 130 pDtetitial^^uXcenters, and 208 schools 
t^iat v^re^-sometimes involved in D&U activities. . 

. 

S9hools of education have tended to be involved^ in jnterorganiza- 
ti^ww^4-^rrrangenients where they are the dominant eg: keystone agency. 
This reflects the tracfitional view^held by in SCDEs that they arm^ 
imparting information to the practitioners, "^s demands for parity in 
school improvennent programs increase, schools\qf education 'wil 1 be 
forced", to modify this traditional view. C\ 



Effectiveness ' • . ' 

Based on the pi^oductivi ty studies summarized in the C]*ark and Gutja-v 
report, the authors conclude that "faculty in approximately 2,250 SCDELs 
are significant- producers of D&U artifacts being distributed to^practi- 
tioners and are conduits for the'^distribution of tMs material'^ (p. 24). 
On the other hand, many practitioners have negative perceptions/of the 
role that! SCDEs play in school improvement, typified by: 

• su^picion/tnat SCDEs are divorced from the yorld'of '* ^ 
practice; 

incredulity about R&D as a vehicle* for educafem|l 
improvement \ - ^"^^^ 

r doubts about whether SCDEs have sufficient j'nterest"flr 
Me?(ibility td assume newer linking agent roles' in s. 
*^ improvement. \ ^ * 



Policy/Research Recom[nendations' 



This was a policy study that assessed the. likely impact of various 
federal' policies in D&U on' SCDE involvement in school improvement.^ The 
authors conclude by recommending federal programs of training, capacity 
building, and .networking in which they- think schools of education ^should 
be in-volved. More ^pecifical ly , they recommend: 

Training: 

• The initial emphasis for SlSDEjs iij/D&U training Should be 
placed on program devel opmen;C---gf^nts rather than operating 
grants, (p. 47) 

• A major thrust in both program development grants and, 
subsequently, training graf^fs should be placed -upon train- 
ing for linking agent roles, (p. 48) | 

• The design of a training^support program for D&U in SGDEs 
should reflect a comprehensive/view of both training rjeeds 
and trainers, (p^ 48) 
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Capacity Building: 

• (I 

• SCDEs shoulll be included as agencies whicfi are eligible 
to compete for capacity building^grants in D&U. ' (p. 50) 

if- A capacity building grant program for SCDEs shouiti inclu'^e 

(a). grants to SCDEs in which D&U capacflky^is already well 

es;tablished. arid (b) grants tp developing institutions. 

(SCDEs) which might be encouraged to expand or improve 
their D&U capacity, (p. 51) 

Networks: \ ^ ' 

• A first step should be the establishment of "network evalu- 
ation grants" to assess the effectiveness of intact networks 
including SCDEs, LEAs, and other educational agencies, (p. 52) 

; • Explicit attention should'be given by such federal programs 
as NDN and RDU to creating a mutually satisfactory mode of 
involvement by SCDEs in such networks, (p. 52) 

' ^ * 

• A new program of grants should be initiated to provide foK 
the support of networks operated by SCDEs. (p. 52) 

• An exploratory design program... should be initiated in a 
f.ew..^efec1:ed states to experiment with the use pf SCDE ' ' 
facu^lty as linking or extension agents to LEAs. (p. 54) ^ . 
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J. FrankeT, L. M. Sharp, and A. D. Bidennan. Per:formers of Res^rch 
f .and Research-Related Activities in the Field of Education \^1979). 



L. M. Sharp and J. Frankel. "Organizations that Perfor^m Educational 
RScD: a First Look at the Universe" (19^79). 



Background/Scfope ' • 

The American Registry of Research, and Research-Related Drga/iiza- 
tions in Education (ARROE) project was primarily descripti ve--portrayed 
by its authors as "designed to provide a map of ttie universe" (Sharp 
and Frankel, p.. 6). The final product was a registry of educational 
research, development, dissemination, and evaluation (RDD&E) agencies. 
From an injtiar population of 6,300 survey4eligible organizations, 
2,424 organizations in 1,530 institutions. were subsequently determined 
to.^involved in educational RDD&E. . 

Fdr the purpose of ouV pre^nt cross-case analysis, the ARROE re- 
port has a pervasive disamlity. There is no way to disaggregate dis- 
semination or school .improvement activities , from rese^ami^ development. 
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and evalLhation. The authors address this issue on only the most general 
level and their conclasions should be noted; 

t Research is emphasized most heavily in the acadegiic and 
private sectors while develoRpient and evaluationVstudies 
dominate in public education agencies. Dissemination 
emerged as the area of lowest emphasis > receiving the 
smallest allocation of funds^by-performers- except -for - 
. state agencies and large pijblic school systems. (Frankel 
/ et al . , p. ix) 

• Organizations of all kinds spend only a small proportion 
ofth^ir funds for dissemination activities. (Frankel et 
al., p. ix) ^ 

it. 

The ARROE study did not have schools of education a's its primary 
target; SCDEs appear in these- data because they are RDD&E producers.^ 
When they do appear, "they may be a school as a v/hole, a depantment, or 
a .bureau or center. Thus a single university may have multiple entries 
as academic organizations performing RDD&E. * 



Context • - , 

Organizational characteristics. "In the academic world, most of 
the work Is carried out in organizations whose primary function is in- 
struction..." (Sharp;.^nd Frankel, p. 8). ARROE classified rougMy one 
fourth of the-jdentified academic. organizations as-^RDD&E specialists. 
Most of the fnvolvement was within SCDEs. The part-time nature of the^ 
enterprise is emphasized by the size of th£ investnWt in RDD&E on the 
part of academic organizations; 37 percent spent less^^h^n $100,000 per 
year, 55 percent spent spent less than $250,000 per year, and 76 percent 
spent less than a million (FranJ<el et al., p. viii). Another view of ^ 
the same basic point: One quarter of the organizations .had no full-time 
professionals primarily engaged in RDD&E; 53 percent had five or fewer. 

Incentives .' The ARROE data do not directly reflect intra-SCDE or 
-IHE incentives for engagement In RDD&E. The authors do note, hoy/ever, 
that RDD&E functions are complementary (not primary) missions in IHEs; 
and that across all types of organizations, but especially In IHEs, dis- 
semination is~not^' common staff specialty^' (Frankel et al., p. x). 

Funding sources^ Modest as the investment/*nay be, "in terms (ff . 
dollars spent, the academtt sector outdistances the pubjic education and 
private sectors" (Sharp and Frankeli, p. 10). In fact, the academic sec- 
tor accounted for 47 percent of the RBD&E funds reported received from ^ 
various sources (Sharp and Frapkel , p. 11). The ARROE researchers note, 
"It Is clear from our findings that, in the aggregate, state, ' interme- 
diate, and loc*al education agencies have made meager allocations for 
research and research-related activities, ani that relatively^little 
tfuly locally anchored work Is being carried out" (Sharps and Frankel, 
p. 10). * ^ 
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Pperatlans ^ ^ * ' \^ 

The ARROE prcJvides,. no descripti\ie* (Jata on school improvement opera- 
tions involving Schools, of educatibn? The report is most usefu*! in 
picturing the relative scope of RDD&E- activities across ^^^y^^yP^s, 
e.g.: ' • ^ • ;'\ * 



• The academic sector accounted for approximately 6ne half 
of 4:he:*organikatiQjis, stal^f, funds involved in educa- 
tional RDD&E. A 



• The.^study identified 25 major performers in RDD&E--agen.cies 

with yfearly expeaditures of '$5 million or more. Thirteen 
^of Ij^iese^ were uni versxty-based. Fifty-three, percent of 
\he organizati.ons. exceeding* $1 million in RDD&E expendi- 
Uires/in 1977 were in th^-academic sector. 



Pol icy /Research ^Recommendations « 

The ARROE. recommendations are chiafly corfcer^d with further 
studies, to wit: ' . ^ - 



)at^/the r^tur^ of ecfucational ftDD&f in the 
|probabl<y best understood by 'studying, in 
' ;t\etween'20ff an3^300 performers. ...[0?fe 
/*,these s^te§V based on the ARROE data, 
would most ltkd#k- be in academe.] (Sharp and Frdnkel, p./9) 



It seems clear 
United States is, 
depth, ^ a group 
hundred to 150 



In the academi(f5;'sa3atorv v^^also^ classifying e 

0 r qa n i z.a t i j>n b i^tme (^^5^1 collegre; schooT; division/ 
department; instito^ and program) and by 

whether tlW orgamzSti'on is special ized^ to the field, of 
6dijcat;ifcn. ^^e ^ofr thesi^' variables would allow f-urther 
studyvof morejTiomogelhpous groups and a better sense o^ 
the extent tcywWch j'nterdisctptinary approaches and - • 
knowledgs^^fflpn fields ipt her than, education and psychol- 

'Ogy are brought ta be^> upon^ttje study 'of topics related 

"to education, '{^ra'rikel et ai.,^p. -189) . 
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R. G* Havelock, A. fi.' Hubenn^n, N. S.« Levjnson, and P. U Cox. Inter- 
organizational Arrangements as an Approach to Educational Practice . 
' ImpTovement (1981). , '' ^ : m 

. M. 'Hubenrfan, N,. S. Levfhson, and R. G. Havelock., Outcomes of 
Univ^ersity-L inked' School Networks (1981). 



N. Sv Levinsori. . School-University Collaboration Supporting School 
Improvement: The Eagtern. State Ca$e (1981). 



Background/Scope ' . * 

The Knowledge Transfer Institute (KTI) conducted an 18-month field 
study of three interorganizational arrangements, each of which linked 
a college of education with a set of school flistricts. The arrange- 
ments were chosen as being relatively stable (with four or more years 
in operation) and not dependent on federal funding for core operations. 
KTI employed interorganizational and knowledge transfer theory as the ^ 
logical structure for the inquiry, and used techniques of investigati,ve 
social research in developing the case studies. Each arrangement was 
considered "a case"; within each ,casef- sub-units <Jere studied inten- 
sively. Cross-case analysis focused on identification of common varia- 
bles in an effort to "isolate 'streams,* of antecedent and intervening 
\iariables leading to the principal outcomes", (Havelock et al., p. 2). 
The three cases involved the pseudofiomous Eastern State University (an 
arrangement between the office of field experience and five county - 
districts plus three teacher centers); Eastern Private University (a'» 
venerable school study council that had, been recently revived); and 
Midwestern State University {a federation of teaqher centers spanning 
• a state).^ ' ' ^ 



Context 

A number of contextual items in SCD^s will be cTescriBed in the next 
section on operations, since the researchers attempted to link operating 
characteristics of the IQAs (including, of course, the schools of educa- « 
tion) with outcomes. In this sub-section, however, it is worth noting 
that the university context does provoke conflict in incentives and re- 
wards between R&D and service or school improvement. In fact, the- . 
researchers were concerned that the two do not m\x well. In^the most 
research-oriented of the three sites. Eastern Private Universrity, de- 
spite the success in revitalizing the school study council there, "the , 
university appears to be reducing its support and rec^janneling funds 
toward research functions which most faculty covet arid, value more highly 
than outreach and service" (Havelock et.al., p. 7). The stronger commit- 
ment to service bn the part of puolic institutions, noted in Jh^yburvey 
studies, was reflected in these cases. 
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flperations ' 

. *• ' 
In this case study, "operat-ions" refers to the functions of the 
interorganizational arrangement itself rather than to those of the 
sfhool of education. With a caveat about generalizing from three in- 
stances, the researchers note that posittve outcomes for the lOA seemed 
to be associated' with the following variables: 

L Antecedent variables 

f a foundation of informal Links between school and 
university personnel 

f a positive history of collaboration 

• goal congruertce among member units 

• agreement on turf 

2. Staff and leacf^^ship variables 

• "homophily" o\,th'e linking agent and staff at the * a 
school and university ^ ^ 

• amount of influence the linking agents(s) wields(s) 
v/ithin^the university 



• a valuing of craft knowledge by^uni versity 
participants ^ 

3, ' Project/structural variables 

• formalization of the IcfA 

f fev/er but longer-term projects * 

. f a multiplexity of ties across agencies; multiple^ points 
of linkage 

f a multiplicity of ro'les played by the boundary spanner 

(resource finder, solAition giver, .process helper) 

In terms of the type of service rendered,' the inquirers' note that "the 
modal pattern--and the most successful--entailed college-based staff 
taking on di^rectly a problem-solving role with local' schools and in- 
dividual teachers. The knowledge base used here was less scientific 
or research-driven than craft-validated products" (Havelock et al., 
p. 9). 

* 

Effectiveness 

The researchers tracked outcomes in five areas: changes in 
power, or status, linkage, practice development , ^capacity changes, and 



39 



institutionalization* The sites were diverse and the^evidence varied, 
but most sites exhibited positive status in most^areaj 

Power/status. All sites evidenced some change, ^t Eastern State 
University (ESU), practitioners felt the arrangement brought districts 
'into the educational mainstream; both ESU and Midwestern State Univer- 
sity (MS,U) reported heightened professionalism for teachers.^ ESU shoved 
evidence of- enhanced university leverage Jn the field. Eastern Private 
University (EPU) reported the arrangement served an enrichment fun^ction 
for participating school districts. ^ ' ^ . 

/ Linkage . All sites offered some Evidence of improved linkage, e.g., 
'better av/areness of needs and resources to meet those needs, or increased 
'exchange of ideas andnnaterial s. 

* • 

Practice improvement. Although a few examples of positive cTiange 
were noted, evidence in this area was ambiguous. The study had in- 
sufficient outreach to document such changes if the^ occurred. 

Capacity. ATI sites reported positive changes. For ESU, the ar- 
rangement clearly enhanced the university's field-based operation's. The 
three cases offered evidence of increased actual or perceived problem- 
solving capacity in the LEAs. 



I ns t i tu t i ona 1 i zat i on . 



is likely 
likely, to 



to continue at 
i nstitutional ize 



_ A mixed* bag: EPU is 
one field site, but not 
at all sites* 



an lOA in jeopardy; MSU 
at another; ESU is 



Pol icy /Research Recommendations 



Their requ4>^es for effective lOAs reflect the policy recommenda- 
tions this team" wotrid flfiake to schools and colleges. At a broader policy 
level., they suggest \jthat: 



• University-schocn collaborative ventures can and should 
include more If^arTwe^way transfer of information from 
a knowledge^produci ng agency to a consumer. 

• The university is an effective vehicle for practice 
improvement, and investments in this vehicle ought to 
be made in institutions with strong service orientation 
and a stable, active clientele. 



TDR Associates, Inc. Case Studies' of Inteorqanizatjonal Arrangements 
•for the Exchange and/or Delivery of Knowledge Resources to Improve 
Elementary-Secondary Education (1981). ^ 

Background/Scope 

TDR Associates conducted three case studjes of int^rorganizational 



arrangements involving institutions of higher edi^ati^n and school s'ub- 
districts (referred to as the, Boston Pairings). Theje particular lOAs 
shared five characteristics considered significant by the inquirers: 
They were (f) imposed (mandatory for*the schools); (2) externally,, funded 
(3) tripartite (or larger) in membership; (4) decentralized and semi- 
autonomous; and (5) focjised on educational excellence and equity. ^ 

The purpose of the project wa's-to judge the "success" of ^ach 
pairing according to the extent that-^movefnent -Qccurted toward the fol- 
lowing curricular goals: (1) extended programs, (2) improved program^, 
(3) new programs, (4J increased access to h.igh-quality education for 
poor and^minority populations,^ and (5) institutionalization of goals * 
1 through' 4 and of the pairing itself. 



Context 

As was noted in the KTI summary, the researchers linked the oper- 
ating characteristics of the lOA to outcomes, and a number of those cdn- 
textual features will^be discussed in the next section. However, there 
ms special effort made to test out the stages of development of an 
lOA, and these seem worth noting in this contextual depiction. In its 
project proposal^ TDR had "hypothesized that the 'career' of each pair- 
ing could be recapitulated as a struggle for power among the partners" 
(p. 3). Although that struggle turned out to be less dramatic than 
the inquirers had imagirved, they did document a six-stage process that 
^as found i*n each pairing: 

1. ' mutual wariness 

2. cooperation b^ necessity in order to* move ahead 

3. development of understanding and respect 

4. collaboration among trusting equals 

5. fighting against the outside world as a-llies 

6. devising mechanisms to preserve the lOA. 

Operations " ^ ' ^ 

The researchers conclude that the following five characteristics 
all play essential roVes in the successful evolution of lOAs lik6 the 
Boston Pairings. The mandatory nature of the arranofement, the threat 
of intervention by the Bureau of Equal Educational Opportunity, and 
pressure from the local media all served 'as formiLj*gati ve reinforcers 
of 'the pairings. The availability of external funds was a pov/erful 
positive formal reinforcer of a successful pairing. The tripartite 
membership strengthened feelings of ownerhsip of the pairing s activi- 
ties, avoided two-paKy standoffs, and extended th*e lOA's resources. 
The decentralized natijre of the arrangement made the lOA programs more 
responsive to local needs. And tjie substantive focus on educational 
excellence allowed the partners to avoid becoming helplessly entangled 
in issues of desegregation. 



* An interesting observation about kjiowledge transfer: 

The'^ participants in the Boston Pairings., .seem studiedly unin- 
terested in [formal R^iD products,]* *. .T4ie predominant form of 
knowledge transmitted was situational (based on specific en- 
counters in actual educationa-l settiags); followed by craft . ^ - 
Research-based. know!i edge extremely rare. (pp. 6-7). 



Effecti veness • • . 

The Boston Pairings all achieved at least partial progress on the 
criteria of .extended programs, improved programs, and new programs. 
Each made progress toward institutionalization. The report npted that 
it was difficult to .judge progress toward increased access to quality 
/education by poor and minority clients, but "...it is likely that 
mavement toward this goal also occurred," since the majority of chil- 
dren in the districts studied were from poor or minority homes (p. 1).^ 

Pol icy /Research Recormiendations 

TDR makes one observa t i o^wh i ch , if correct, v/ould clearly affect 
change agents or organ.izationWconce(^ne^ with establishing lOAs: 

We believe t|iat afJproximations of these characteristics of 
the Boston Pairings--mandated participation, funding from 
outside and additional to regular budget'i^ multipartite mem- 
bership, decentralization, and a lioncontroversial general 
goal--are required attributes of^IOAs constructed to change 
education through the exchange of educational knowledge., (p. 3) 

The researchers also suggest further inquiry into the role of 
research-based knowledge in school improvement: 

Perhaps this hypothesis ought 'to be expanded further, to 
state that the ex^change of res6arch-based knowledge re- 
quires the scene-setting exchange of situational and craft 
types before it [the scientific exchange] can take place. 
Lack of appropriate attention to the preliminaries of 
research knowledge utilization may be an important reason 
why the R&D dissemination process is usually so discour- 
aging; so many proven' curricula and discoveries available, 
so littTe i/se of them.... We can hypothesize that the need 
for knowledge utilization fits into a hierarchy of needs. 4 
It would seem the schools are not ready to utilize knowl- 
,edge for ^improvement of schools unti"l basic needs are met. * 
. . .The v/ider' the participation of all individuals in the 
process of exchanging knowledge on how to bring about " . 
change, it may be hypothesized, the more effective will be \ 
the eventual uge of)research knowledge, (pp. 7-8) 
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Section 2> Gross-Cas-e Comparisons gf -Studies on the Role 
of Schools of Education In School Improvement 



As vvas* ri'(Jfed in the introduction, .there' is, little 'point in at- 
tempting to sum or aggregate variables across cases within this popu- 
lation of cases* Hov/ever, Table 1 dep^let5"the--extent to v/hich a 
variety of variables were studied in the f,ive cases and notes the 

effect they seemed to have on the involvement, of SCDEs In 'school 

improvement. Table 1 will be used to address yx questions about the 
roTe of schools of education in school improvement. 



TABLE 1 



Cross-Case Comparison of Cirganlzational , Operational, and Outcome 
Variables which Ha^e Been Usett^o Study SCDE Involvement' in School 
^ * Improvement Activities ^ 





Cases 


i n 


which 


Likely Effect on 




Variable Was 


SCDE 


Involvement 


Inventqry of Variables 


Exarrvlned 


* . '' 


in School 


Improve- 












ment 






* -f 


1 


2 


3 


4 & 


+ 


0 




Personnel Characteristics 






# 










-highly trained; % with doctorate 


X 


X 


X 










-limited KU training 


X 


X 










X - 


-limited retraining opporti3nit1es 


X 


X 










X 


-substantial (modal 5-10 years) 
















LEA experience 


^ X 








X 






-inconstancy of administration 


X 












_^ X 


SCDE Unit Characteristics 
















-large no. of institutional sites 


X 


•X 


X 




X 






-widespread* geographic placement 


• X 








X 






-frequency of. forma Hy stated 
















KU mission 


X 


X 






X 






-primary mission in preservice 
















teacher training 


X 


'X 


X 








X 


-involvement in KU on part-time/ 
















basis 


X 


.X 


X 








X 


-commitment of public SCDEs to KU 


X 


X 




X - 


• X 






-lack of commitment in private 
















SCDEs to KU 


X 


X 




X - 






X 



*Cases were (1) Clark and Guba, (2) Lotto and Clark, (3) Frankel , Sharp? 
and Blderman, (4) Havelock, et al., (5) TDPs Associates, Inc. Jhe reader 
should recall that cases (1) and (2) employed the same empirical data base. 
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TABLE. 1 (continued) 


■ 








1 

*■ * 


•Inventory of Variables 


f Cases in which 
Variable Was 
Examined * 

12 3 4 5 


Li1<e1y Effect on 
SCDE Involvement 
in School Improve- 
ment 
+ 0 






' ■ , — J 

Contextual Features of SCDEs & IHEs 
-ideographic culture 


- X -tT - - - 


X 




X 








-professar as entrepreneur 

-professor as expert' 

-low status-pf service in IHEs 


X X - •- - 

X X X X - 


X 




X 

X ' 
. X^ 


« 


O if 




*• 

Incentives 
-dominance of R&D in the reward .. 
system 

-released time fx)r ijivolvement 
in KPU • . • 

-legitimation of private con- 
sultative relationships with 
LEAs ' 

-inclusion .of KU jn IHE reward 
s^^stem • - . ' 

-large no* of masters-level SCDEs 
in wmcn ku is honored by 
IHE 


X X X X - 

X X - - :- 

X X - - - 
X X - x - 

X X .. x - 


X 

X 
X 


V. 

V 


X 
X 

X 








Funding Sources 

-local support of KU bureaus and 
centers 

-general local support through 

. released time 
-concentration of external sup- 
port fo^ KU 


- X -X - - - 
X X X , - - 
• X X . X - - 


X 
X 


- 


• 




e ^ * 




Scdpe of Operations 
-over 500 ope rati ve^KU centers 

'^"n SCDEs 
-circa one half of all organiza- 
* tions involved in RDD&E 


- X - - - 

■ - - 'I - •- 


X 
X 






4 


* t i 

• * 




Type of Service - . • 
-indi viduaV ad hoc services to 
^ ' schools 

-university staff as probleiji- ^ 

solvers, ^ 
-knowledge type 

-research-based 

-craft validated 

-sitaational 


• ^ f 

. X X - - - 
•- - - X - 

r 

' - - " - x ;x 

- - - X X 

- X • 


X 


X 


X 
X 




1 




.*Cases*were (1) Clark and Guba, (2) Lotto and Clark, (3) Frankel, Sharp, 
and Biderman, (4) Havelock, et aU, (5) TOR Associates, Inc. The reader 
should recall that cases (1) and^ (2) employed the same empirical data base* 
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TABLE 1 (continued) 



Inventory of Variables 



Effectiveness 

-^■^UcLDt i t a 1 1-ve^p rodu ctiv^lty- _ - 

-predominance of articles 
piiblished in practitioner* 
journals 
-production of books in , 

education 
-production of textbooks 
-presentations at practitioner- 
oriented c-emf^rences 

Perceptions 

-divorcement from world of 
practice 

-incredulity regarding educa- 
tional R&D role in school 
improvement ^ 

-doubts about interest* or^ 

^ % flexibility of SCDE in KU 

Achievements of Operating lOAs 
which 'Include SCDEs 
-power and status changes 
-linkage improvement 
-practice improvement 
-increases in capacity 
-institutional ization 
-extended programs 
-new programs 
-educational access 



Cases in which 
Variable Was 
E-xami ned* 

1-2 3 4 5 



X - 

X -■ 

X - 

X - 



- X - T - 

- X - X X 
X X - - - 



X 
X 
X 
X 
X 



Likely Effect on 
SCDE Involvement 
in School Improve- 
ment 



' ' 0 



X 
X 



X 
X 
X 
X 
X 
X 
X 



X 
X 



*Cases were'(l) Clark and Guba, (2) Lotto and Clark, (3) Frankel , 5/iarp, 
and Biderman, (4) Havel 0(5|<, et al., (5) TDR Associates, Inc. The reader 
should recall that cases (1) and (2) employed the same empiricaJ data base. 
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Question N -What is the scope of SCDE involvement in school improve- 
ment activities ? 

Schools of education* are involved extensively in school improve- 
ment programs: 

• Seven of 10 faculty members in graduate-level SCDEs report 
' ^ ^ej^onal ad hoc service arrangements with schools. 

<»: ^ * 

•••T^*'^ hundr§fl seventy-two schools of^ducation maintain one 

or more KU centers, bureaus, or institutes (551 in all). 

• Lotto and Clark >estimate that well oyer 400 SCDEs could be 
classed as at least "sometimes involved" in.KU activities. 

# 

• • The products of SCDE faculty work in KU are visible nation- 
ally in journal publications, texts, and convention presenta- 
tions. 



Even faced with a paucity of detailed i'nformatlon on the involvement 
of SCDEs in school improvement, it is cTear tmt schools of education are 
old-line agencies in this field; knowledge utilization, dissemination, 
and school improvement are defined as institutional objectives by hundreds 
of graduate-level schools of education. Any picture of these agencies as* 

somehow cut off from the field of practice is inaccurate. O^esTpfte the-- 

status attached to R&D productivity in college and universities, schools 
of education are quantitatively more heavily .Invested in knowledge utili- 
zation and service programs. 

Question 2- -What organizational characteristics seem to influence the scope 
or. effectiveness of SCDE involvement In school impro^^ent activities" ? ^ 

This answer begins where the last left -off. At least within the 
confines of doctoral -level universities, and especially among those 
that maintain major R&D programs. Involvement in school improvement proj- 
ects Is a low-status activity. It is not competitive with research in 
the formal rewar;dsystem. It exacerb'ates the SCDE's already low status 
in the universi tyr*^&tft relative status is surely not alone as a. character- 
istic interfering with inst1^tuti^5nal productivity in KU. School^ of 
education are bound to instructional head-count budgeting. Aljo^ profes- 
sors tend to come to an SCDE with a doctorate but limited training 'in KU. 
For the most part," retraining or inservice education for faculty is an 
innovation that has yet to be institutionalized on 'university campuses. 
School^ improvement projects are high-risk ventures. The problems are 
tough, the solutions complex. It ts obviously tempting for the pro- * 
fessor to Stay within the confines of the classroom. 

On the' other , hand, there are definite pluses for school improve^ 
ment programs in this environment. There are literally hundreds of 
graduate-level SCDEs^circa 250) in which R&D is not a primary mission > 
and In which knowledge utilization programs fit very well. -*Even in 



most of the research center SCDEs, KU is a part of the formal institu- 
tionaT miss.ion ^statement. Schoo,! of* education Ijtudgets; are built around 
the teaching function, but in contrast with SEAs, LEAs, or private R&D 
agencies, SCDEs have greater budgetary flexibility in spending local 
funds on school improvement.. They do, support KU bureaus,- cg^nters, 
and in^titLftes, ^nd faculty receive released time for individual and 
i'nstitution^Hy based w<?rk wit^h LEAs. 

Professors in SCDEs may not be formally trained as liQking agents, 
but tiTey do have strong roots of experience in local schools (modal five 
to 10 years of experienc'^). The geographic spread of schools of educa- 
tion across the country creates opportunities for close personal contact 
with clients. The histori^c commitment of SCDEs to school improvement 
(encompassing such national movements as laboratory schools, school study 
councils, curriculum and materials centers, o^^tion research, and more 
recently, teacher centers) provides a: stable institutional base for con- 
tinued KU activity, 

Schools of education fare differently in relation to this question 
depending on whether criterion-referenced or normative tests are u^ed 
to evaluate them. In the former instance, the organizational character- 
istics that impede involvement in school improvement .projects stand out# 
However, when tontrasted with competitive agencies which contain even 
greater^ organizational impediments, SCDEs seent relatively hospitable 
sites for KU programs. 

Question 3- -What incentives or disincentives exist that influence the 
participation of SCDEs in school improvement ? 

This question needs to be addressed on both an institutional and 
an individual basis. Schools of education exist in an institutional, 
envirbniiient that vacillates about ^rvice or KU involvement. This is 
.frequently not considered a high-status area^ but most IHEs ^need to 
(^emoffiBtrate service contribut%ions to tneir states and regions. Service 
activities .often require -the mobilization pf institutional resources 
bur IHEs operate as primarily idiographic organizations. Colleges and ^ 
universities are funded to meet classes but the level of funding is 
•frequently "determined by the satisfaction of their i^service programs' 
clients. -J 

There, are two relatively clear and consistent patterns that emerge 
from the several studies about institutional cc^mi tment^to school im- . 
pr6v6ment. First, public SCDEs assert a more vigorous role in KU than . 
their private counterparts. And segondly, lower-prestige^ doctoral insti- 
tutions and masters-level SCDEs experience less conflict in asserting 
an unambiguous commitment to service. ' -jT 

Of course, SCDE professorial staff share in the ambiguity ofAhe - 
IHE posture toward KU activity. At the level of formal inission state- 
ments, professors see an institutional commitment to servi.ce. Their 
superordinate administrators often voice the -commitment publicly. But 
it' is obvious, at least in doctoral-level SCDEs, that no one tan be 
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promoted or granted tenure ,on the basis of his/her Service Icontribu- 
tionsi such rewards are made, ^ however, on the basis of excellence in 
R&D. From the IHE's point of view, most professors are provided with' 
released time for (either or both) institutionally sponsor^ or ]r\H^ 
vidually negotiated KPU activity. And it should not be overlooked 
that KU achievements are a part of the formal IHE reward si^stem--just 
last amon^ equals. For many professors, incentives tp work with 
schools come not from the university but from the.scj^ols in the form 
of cohsultingfpfs and positive int>erpersonal reinforcement. 




• The un/7e<HP^ is schizoid in its commitment to and reinforcement 
of knowledge utiTization or school improvement activity. This condition 
is likely to erfdure bacause the conflict on which it is based is rooted 
'deeply in the traditron^ of the university. This conflict- is df^amatic- 
ally illustrated i(j^y the current budgetary and enrollment declines in 
IHEs. Universities have responded to* these exigencies by searching for 
alternaJJve areas of perfbrmanc^ that might offset deficits. Tighter 
linkage?!With local and regional public a^encTes'and with business and 
industry^^-more esiphaSis on service--have been natural .areas of growtfi. 
Many universities t>ave .initiated or a*>€^lanning such ventures. Sijnul- 
taneously, almost all IHEs Have increased the intensity of their pro- 
motion and tenure processes/ and*/they' have doneN^this chiefly by Increas- 
ing the emphas-is.on R&O as'-a'criterion for promotion and tenure: an 
organizational dilemma that will not go away. 



Question 4-- What jfun^g sources are used'-to. stjpport these SCDE scKool ' 
imprO \' • - - 




ere 'are no precise data an how school improvement prograjns are 
paid for in SCDEs. Schools of education receive more federal and founda 
tion support for educational KPU acti)7ity (^han^any other educational 
agency.^' But most of that support is for-R&D.' Schools of' education 
have 'beea excluded from the major dissemination 'and school improvem^jfitT^ 
programs of the 'Departmentv of Edycat?©^^ e. gt>, the National Qiffusion . 
Network, the Research and.^^eltipment 'ESj^change-Teven substantially from 
Teacher^ Centers, the.jjjy' ca p^c i^- bu i 1 di n g programs^in school im^ 
proveme# have involv^ MTs or SEAs. "Schools of education ar6 heavily 
dependent on^outside funding, but the bulk, of that funding goes for 
research or cKTOn^^e <>training or general student fellowship and loan 

leveral studies have noted that SCDEs do pjace some of^^their 
own mJnies into school improvement; bureaus- and centers are evidence 
of this ||location. ^'When^^such centers receive outside funding for^ " . 
scffbol iiffrov^ent projects, it i,s more^ikelyto come from' thfr cl Vent 
•served than from the. federal government or fimn^oundations. the ^ 
major 'budgetary allocation' by SCDEs comes> of.couVse, in., the fqrm of 
20 to^25 percent j^^el eased time for faculty to engage in KPU activity. 
Since'^ ttiis. is a hon-spe^fic way to fund such Activities, it is diffi- 
^••cult* to measure how much money is actually expei^ed on ^school improve- 
ment'.- However, most observers gue-ss that the figure is sizeable. 
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Question 5- -How can SCDE activity in schoM improvement best be described - 

(^e>g>, in. terms of clients, types of s^oH^ce^T organizational arrange - ♦ w 

' ments^to support ^tffe services )? ' 

' "o ^ 

losing the studies on SCDE involvement in'school improvement con-' 
ducted so far, the answer is: Such activity can hardly.be described 
at "all. More recent efforts, such as th6 KJJ 'and 'TDR studi es> begin, . ^/ 
to build up a base of descriptive data on partfjcuJar lOAs for school 
improvement. Normative, studies' such .as /the Clark-Guba and ARROE eff^lts ^ * 
offer only broad descriptions qf SCDE operations, e.g.: * . • * ' 

, ' » ■f ' \ 

% There appear to be^ a large number of professors working '/^ 
individually with LEAs on specific, ad hoc* problems. 

; t-ManySCDEs operate field servic'e bureaus to contract pri- 
marily with,LEAs on^ad hoc problems. . . 

— ^ ^V'SCDE staff maKe frequent one-shot apfieajrances at -work- 
shops, conferences, and seminars for practitioners. - They ^ . ' 
are used a^: "outside experts^ • . " ' \ 



/ . ' solving. 



There ^re from 50* to 100 school study council s linking SCDEs 
with LtAs for purpose? of dissemination and local problem 




Much of the contact ^between 'SCDEs and LEAs is only tan--^ " ^ 
gentially related to school improvement— it involves student 
observation, teaching, andlinternship arrai/igements to^u£iport 
the seOE*\ instructional function.*^ 

More T;ecent S,CDE-LEA arrangements have been built aroCind 
locatrj^ sponsored or jointly maintained teacher centers. 

• Many SCDE faculty exercise their KU function in the^conven- . , 

^ ' tional media^of the university, e.g., writing for practi- . • ^ r ' 
^ tiooer journals,* publishing textbooks, and speakjng at , 

conferences and conventions. ' ^ 

Question 6— -What is the perceived and/or actual level of effectiveness 
trf -S€BE?4schoo3 improvement activitieT ? 



Clark ^and Gaba argue, sans perception dat^that practitioners and ^ 
policymakers hold negative views of SCDEs as effective school improvement 
^ag^ncies (i.e., 'they are divorcfed from practice, not skilled in prac- 
titioner interaction, more interested in R&D than in KU). Whether or 
nat this^ is true of individual prarctitiorters or agencies, rt seems 
^ * to have been) true of federal-level* policymakers in shapi-ng. di ssenti na- 
tion prt)grams, and of the organized teaching profe^slpn in proposing . 
and supporting teacher centers. • - » . 



r 
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Ther'e are, in fact, very few data on the ef feet ■iJ\(e:nes'5'>of. SCDEs 
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in school improvement. The reason for this paucity of data is ^'mple. 
Almost ^11 evaluations of school improvement programs have been com- 
missioned and paid for by the Department of Education and its preder 
cessor agencies. The department was concerned with evaluating its 
own programs and SCDEs were not a part of those programs. . W6 thus 
harve been provided with substantial evaluative data on, for' example, 
the NationaJ Diffusion Network, but nothing substantial on school, 
study councils. The currently available evaluative data on school 
improvement, efforts Involving SCDEs ^ou Id not survive close scrutiny 
and criticism. 



The few data that are available seem positive 
hant in the publication of materia! read by practiti 
tioner journ'^1 articles, textbooks). Both the KTI 
report positive gains *in most of their criterion 
they studied. Many of the SCDE ventures in school 
required funding by cl rents (bureaus of field servjice 
consultancies, school study councils). These servlices 
to "sell" over long time periods. 



SCDEs are domi 
oners (practi- 
and TDR studies 
^reas in the lOAs 
improver^ent have 



ind-i vidua f 
have continued 
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V .... 

Section 3. Implications for^ Researigh and Policy 

• #■ 

^' ^ - 

The reader^as already had the Gpport:unit5^ to review the implica- 
tions and recommendations offered by the five cases summarized in this 
paper. Follgwing are the implications that apj)ear most important to 
th.is author. ^ ^ ' . . \ . ^ : 

Research 



/ ■ - ■ .. • - 



1. The dearth of descriptive ^data "cibput school ihiprovewent pro- * 
.grams in'SCDEs--data that can only be gathered through case studies-- 

makes it very-difficult to use'the existing data base for-policy plan-^ 
"ning purposes. Such' data should be gathered^for va^rious SCDE types 

and for^var+ed school improvement programs. * , • - 

2. JWEs are toff extensively invojved in schoo? improvement to. ■ 
allow their efforts to go on without ^valuation. Evaluative data ^ 
would surely support policymakers* in ,dec1di ng how, if at all, to con- 
tinue yiis involvement.. ' 

3. Orga/iizatlonal studies, following up on the earlier contextual 
Studies of Clark and 6uba and the more recent lOA inquiries byKTI and 
TDR, would provide a bejiter sense pf'factors inhibiting an"?l facilitating 
•the involvement of StUfs in school improvement, '^qually importantly, 
such studfes would^ufde policymakers in de^^ermining the variables and 
institutional types that could be favorably affected by.outstde funds. 

* 

4. .Experimental programs involving SCDEs in school improvement 
(e.gi, a capacity-building program) should be Initiated and evaluated 
to provide a bas^is for subsequent invoTvement of schools of education 

'in s^chool improvement ventures. " " - 



Policy ' • ^ * ■ ' 

1. Most of the research conducted to' ddte indicates that SCDEs 
(a) h^ve a substantial capacity for KU activities', -(b) will continue 
to institutionalize school improvement as an 'organizational goal,' and. 
(c) are effective partners with LEAs in* school, improvement. To the 
extent that current budgetary provisions and progr^am limitations will 
allow, the ^federal government should focus on increasing the involve- 
ment of schools of education in its programs of support for dissemina- 
tion in education. 

2. Since many past contacts between the federal government and 
SCDEs have concentrated on a small number of research center doctoral 
Institutions, the Department of Education should extend its scjope of 
support in dissemination and school improvement efforts to masters- 
level program centers. 




/ 



3* Administrators and policymakers at the IHE/SCDE level should 
view school improvement as aTi'ch outlet for SCDEs over the next 
quarter-century. Major efforts should be mounted to reduce the tensions 
between KP and KU and to reinforce the involvement of professorial 
staff in school improvement. 

4. f^ub-ric school practitioners ^d the organized teaching pro- 
fession sHfTuld re-examine ways in which they can worJc with SCDEs in 
school improvement. Schools of education do have considerable human 
and fiscal' resources to bring to such an interaction, and the profession 
is now strong enough to negotiate mutually advantageous alliances. 
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Introduction 
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• . This paper summarizes thnee recent research efforts that studied 
the activities and services of educational service agencies (ESAs):* 
/the collection of reports by Stephens Associates entitled Education 
Service Agencies: Status and Trends ; Yin and Gwaltney^s case studies 
of three regional education agencies. Organizations Collaborating 
to Improve Educational Practice ; and relevant portions of Frankel 
et al> *s - Performers "of Research and ^Research-Related Activities In 
the Field of Education; 



is' then presented, 
consideration by the 



comparative analysis of these three studies 
ToTlowed by four major policy conclusions for 
staff at NIE/REP. 



^'Some £SAs are. called "intermediate service agencies" '(ISAs); some 
others, "regional education agencTes" (REAs). - V^ 
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Review of Selected Reports 



Stephens Associates. Education Service Agenctes: Status and Trends 
(1979). 

» 

This study reviews the development and status of educational 
service agencies; it also di scusses trends and issues related to these 
agencies. - ^ * • 

The bulk of the study contains data from a large-scale survey of 
ESAs. An initial chapter gives a historical perspective on the growth 
of ESAs. Some agencies date from the creation of county school super- 
intendenci^s in the nineteenth century; most developed in the 1960s 
and 1970s. Stephens ideritifies three classes or types of ESAs; 

t Special distri^ct agerrcie's that constitute an official level 
of school governance between the state and locals schools. 
These districts provide services to local schools as 
well as state education agencies. In a majority of states 
having special district -ESAs-, the system is state^wide, 
encompassing all local schools. 

• Regionalized systems that represent an intranstate decentral- 
ization of state education agencies; ESA units are considered 
arms or branches of the state education agency. In almost 
all cases they are state-wide, involving all schools. 

• Voluntary cooperatives among school distryffs. These are 
loose consortia of schools, banded togethir for common pur- 
poses. Few, of these State cooperatives irivolve all schools 
in the state. 

Some states had networks of more than one type of ESA. 

The study does not examine all such ESAs in the United States. 
It reports on 31 networks of such agencies in 26 states. These net- 
works do not represent all of the networks within each of the' 36 
states; some were judged "insignificant" atad not suited. No/ rationale 
was provided for the selection of these pjp-ticular 26 states--except 
that resources prevented a wider study. T^b data collection was done 
primarily by mail survey, which uncovered 9M ESAs operating in the 
26 states during 1977-78. Five hundred and Vne of these were surveyed 
and 314 returned the questionnaires. The forlowing paragraphs sum- 
marize data around specific topics (underscored) ^covered by the study. 

Membership in ESAs was voluntary in some states, mandatory in 
otherTi In 15 of the 26 states, all of the LEAs in the state were 
served by an ESA. Only some of the LEAs in the other states were 
members of ESA networks. 



Some states' ESAs served general populations (the term >yas not 
defined) as large as 1 ,039,000 (Massachusetts) ; the smallest served ^ 
22,000 withi,n the state (Nebraska)^ The geographic area served by 
these state-v/ide systems ranged from 91 yIJ37^5Ai^ire miles (Illinois') to 
1,672 square miles (New Jersey). (Note: iRese populations and areas 
were- not served by a single ESA, but by a state system or n^work. ) 
The variation within each of the tl^ree ESA types identified above was 
as great as those among categories*. The mean number of school dis- • 
tricts covered "by each system ranged from 162 (New Jersey) to three 
(Ohio). The mean student population served by each state 'system ranged 
from 342, OQO in New Jersey to 11,000 in Illinois. The number of 
^'students served fell most frequently within the 1,000 to 5,000 range. 
No distinction between rural/urban membership wa's nbtable--except that 
the largest districts did not tend to' belong to an ESA and a sur- 
prising number of the smallest districts did not belong either. Per- 
ceptions of chief executives of ESAs suggested that they saw themselves 
as serving either urban areas or urban-suburban-rural areas, rather 
than rural areas exclusively. 

Two special features of this demographic \data should be noted. 
While many ESAs served metropolitan areas in several states (including 
New York),- the largest^metropolitan school distn^ts were expliaitly 
excluded from ESA membership. Furthermore, jt is\jnportant to note 
that 56 percent of all of the full-time staff were found in just two 
states. New York and Pennsylvajiia; adding figuresr from Michigan to 
these other two states shows that 67 percent of all the full-time 
staff in a'll ESAs were in just three states. 

No data were reported that indicated the percentage of , schools, 
students, or general population that were served by the ESAs studied 
in comparison w^ith the total number of school?, students, or population 
in the states studied--except, of course, that" the inference can be 
made that 100 percent coverage was involved in the cases of the 15 
states where participation by all schools was mandatory. 

The patterns of how the units were established varied, ranging 
from man^latory legislation in some states, to permissive legislation, 
to state agenc^' approVal, to no higher-authority approval. In some 
cases the state systems replaced or reformed county school systems; 
in other case's there was no relationship between the county schools 
(when they still^existed) and the ESAs. No generalizations from the 
data were provided about the reasons for establishment; however, from 
their persofial knowledge, the authors (Stephens et al.) concluded 
that ESAs have come about because of (a) a growing recognition of the 
difficulty LEAs experience in responding to new priorities (e.g., 
special education), (b) the politital unlikelihood of continued school 
consolidation, (c) the limitations of previous middle-echelon units 
such as county school systems, and (d) the trend toward expanding the 
SEA role from that of regulatory agency to seryice agency. 

Most states 'reported that they expected few if any changes in the 
numbers or functions of ESAs in the foreseeable future--except Minne- 
sota, which anticipated *a consolidation of existing ESAs (58) to a 



smaller number (15 to 25)/ Ohio and Minnesota anticipated some changes 
in functions.-- 



Almost all of the ESAs' (extept three systems opecited by state 
education agencies)- were. governed by boards of varying size and com- 
position. Some members were appointed (e.g., by constituent Tocal 
boards) whil^ lathers were elected. The terms and qualifications of ^ 
board members were extremely varied. and n'o patterns were discernable. 
Most served with no compensation or with token compensation* Male mem- 
bers on the boards outnumbered female members 83 percent to 17 percent. 
, Almost al'l members were Caucasian. 

ESA governing boards had^most no authority over the member LEAs 
--except in Ohio, which gave almost complete authority for school opera- 
tions to ESAs. In Iowa and Michiga-n the boards had limited au^thority 
over SEAs. Many boards were supplemented by -advisory panels in spe- 
cific areas like the education -of the handicapped. 

Th^ executive officers presented as varied a picture as did the 
boards. Some were elected, mos.^^ppointed. Their authority was 
usually limited to implementing board-approved pol icies--but not in 
every case. Their salaries were predominantly in the $25,000 to $29,000 
range, but some were paid more than. $45,000. Virtually all were male 
(95 percent) ']&nd Caucasian (98 percent). Almost all had previous LEA 
experience; ^EA experience was rare. Sometimes, but not frequently, 
a'dministratf^ certification was required. Age was not reported^ 

dlily ft'vB state systems (of which four were special districts) 
had direct taxing authority . Only 18 of the state networks r^teived 
state money; most of this was for categorical programs. 'Cooperative 
networks Received the smallest amount of state money. Twenty-four of 
the 26 state networks received federal money; most of this flowed 
throu,gh the states. Revenue size from different sources ranged from 
millions of clollars to nothing. (More specific data is presented in 
Figtjfe 1, page 64.) Increases in revenue over a three-ye-ar period 
ranged from a low of 20 percent to a high of 465 percent. One state 
(Illinois) reported a decrease. , 

Expenditures by alT ESAs can be summarized* as follows: 



Cgtegory of Expenditure 


Dollars (in mill ions) 


. % 


Education of the handicapped 


282 


34 


Vocational education 


199 


14 


'^'Federal prograni&"--not defined 


76 1 


9 


Administration /. 


75 7. 


9 


Data processing 


50 


6 


Transportation 


41 


5 


Media and library services 


37 


4 


Evaluation 


30 
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Types of services v/ere' broad. Eleven of the 26 program areas 
surveyed were offered by a majority of the 314 units. In descending 
order, they v/ere: general administration, education, of the handicapped, 
media and library services, staff development, curriculum services, 
information services, planning. services, gifted and talented education, 
vocational and occupational education, pre-kindergarten, and purchasing 
services. In the special districts, four other areas of service were 
offered by a majority of ESAs: data processing, financial services, • 
pupiV personnel services, and federal program services. In regional-* 
ized service units, the three additional ar^eas offered by a majority 
were: ^^general academic instruction, research ^nd development, and ^ 
financial services. Though services to nonpublic schools were offered 
by a few ESAs, most did not serve the private sector. A majority of 
ESAs maintained a data ba^ on the local schools they served; this was 
especially true in the case of regio/nal ized systems. 

Seventeen of the 31 ESA networks were formally involved in state 
regulatory functions . Eight of the 11 special district ESA networks 
were so involved; most frequently this activity constituted participa- 
tion in' the development and communication of regulations. Four of the 
seven regionalized networks were involved in regu 1 at primarily in 
the communication and interpretation of state regulatiorfs. Five of the 
cooperative netv/orks were^nvol ved, voluntarily, in state regulations. 

In the 314 £S^, 40,736 full-time equivalent (FTE) staff v/ere em- 
ployed^ Ninety percent were in special districts, eight percent in 
cooperatives, and two percent in regional unitS^ New York alone ac- 
counted for 32 percent of the total FTE; Pennsylvania, 24 percent. 
Program areas for the staff v/ere: handicapped (19,500), vocational 
(3,0jD0), general administration (1,800), pre-kindergarten (1 ,400), 
and media/library (800); Eight percent of the staff were administra- 
tors, 42 percent were teachers, 17, percent were teacher aides. Nine-* 
teen percent w4re classified staff. Tv/enty-nine percent of the posi- 
tions were* f-ederal ly funded. No sex or race data were reported. 

No clear picture of the facilities used by ESAs was presented-- 
except for the information that two thirds of the special and coopera-* 
tive districts could own space while most regionalized networks could' 
not. ' How many actually own^ed spacg was not reported. About one third* 
used free space, mostly supplied by county governments. Forty-four 
percent operated one or more satellite centers. 

* ^ . * 

No cl'ear pattern emerged regarding the cbntact and reporting pro- 
^tocols between ESAs and SEAs; some S ^ s - had a single contact point for 
ESAs, others had none. In most cases, working contacts existed between 
ESAs and a number of office^ within the SEAs. State-wide meetings be- 
tween -^an S£A -and a state's ESAs v/ere commonplace. ^ 

In slightly l^ss than, half of the cases, ^ the legislative or charter 
provisions for the establijiiment of ESAs required formal, periodic 
evaluation . Twenty-three^otrKof 30 of the ESA networks wer^e required 
by mandate to be involve(| in some type of planning. 



Inv^ummarizing the differences between the various types of ESAs,- • 
the stud)( reports that SEAs had more involvement with regionalized 

' systems than they did with the other two categories. They had the' 
least invcWvement with coojjerati vesi Public involvement of LEAs was 
limited fon all three types%f ESAs, but was greatest in the case of 
cooperative^. "Accountability to state government v/as greatest in the 
case of the\ regionalized systems* Accountability to LEAs was greatest 
for cooperatives. Few of the- networks enjoyed a large degree of auton- 
omy. Federal involvement was critical for all three network types. 
Little interaction with post-secondary institutions appeared to exist " 

^or any of the three network types. 

The report concludes that the three network types had different 
potential for contributing to the impro^ment of state systems of 
education. 

t The special districts assisted by improving state-local 
partnership, acting as a platform for resolution 'of state- 
substate-local interests, and facilitating necessary state 
regulatory processes. They also contributed to state-wide 
dissemination and communication capability and saved stat§ 
agencies time and energy. 

N ^ . 

t The regionalized networks helped by providi'ny ttie same type 
of platform for resolution of state-subsfaterl^ocal interests; ^ 
by facilitating Ipng-range planning; and by facilitating 
state-wide communication. 

t The cooperatives, because of their limited involvement in 
state education affairs and because most wer^ not state- 
wide systems, v/ere judged to have limited pol:wtial for con- 
tributing to the improvement of state education systems.* 



*The Annual Report on Study of Regional Edu/:ational Service Agencies: 
Fiscal Year 1981 (Philadelphia, PA: Research for Better Schools. -19^ ) . 
a recent study conducted in Pennsylvania and New Jersey by Research 
» for Better Schpols, suggests two functions for RESAs. Political link - 
age offers information to LEAs about the impact of mandates and helps 
negotiate acceptable interpretations. Technical 1 inkage provides 
research- and practice- based knowledge about instruction and administra- 
tion. Both kinds <tof\ljjik age are enabled by the three RTSA roles of ^ 
trainer, liaison, atnJ monitor. 

Two distinct clusters of agencies emerged from the study, reflecting 
both state policy and the regional demand for services. One group, in- 
cluding all the county offices, did a great deal of monitoring and 
very little training. The converse was true of the second group, which 
^did considerable tra-ining apd little monitoring. This discrete differ- 
entiation of function underscores a state-level decision to separate 
monitoring for compliance from training for capacity building. 
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In terms of their potential for locanpublic school improvement, 
the study concluded that: 

The special districts contributed by providing direct 
instruction to general and special students, and by pro- 
viding instructional services and management services. 

© 

• The regionalized netv/orks contributed by assisting 4n local 
. • planning and dissemination of information. 

• The cooperatives contributed similarly to local planning, 
dissemination, and communication. They also provided direct 
instruction to stjudents, and instructional and management 
support services. / 

In summary, the Stephens study found that special districts had 
many major strengths .Including a structured mode of operation, a* rel- 
atively stable fiscar support base, and comprehensive programs and 
services; their major weakness was the large number of individual units 
in many of the systems. The regionalized systems had as their strengths 
a structured mode of operation and a relatively definite source of fi- 
nancial support; their weakness was their inability 'to contribute to 
improved educational practice at the LEA level. Cooperatives' strength 
rested in their involvement with LEAs; but their lack of organizational 
ability, the absence of definite funding sources, and the limitations 
of their programs and services were major weaknesses. . 
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Figure 1: Selected ESA statistics from Stephens 
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R. Yin andtfM/K. Gwaltney. Orgafnjzat'ionst^ol laborat ipg to Improve 
. Educational Practice (1981). * 

p • ^ , 

This* is a sumniary\of a, detailed ca^se.oStudy of three regional 
. ejiucation agencies (KEAs). The purpose , of the..study was 'to' examine 
' -interorganizational collaboration factors that contribute to knowledge 
•"'nt11ization--the transfer of information or knowledge about better^ways 
to educate from a source to '"^ useri The authors posited that the^knowl- 
edge util"ization function would be different in interorganizational, ' 
_ s?btings than Interpersonal settings;^ -(The focus of this summary is on 
J the REAs and- their potential for school improvement rather than on 
''^ information about interorganizational collaboration per se. ) 

Three REAs were chosen because Yin a^id Gwaltney believe* that REAs 
-not* only have significaat potential for improving educational practice 
through knpv/ledge utilization but also represent broad examples of 
interorganiza'tional collaboration-rbetween local schools,^ the REAs, and 
state departments of education. Some of the possible knowledge utiliza-. 
tion advantages of REAs cited by Yin and Gwaltney include: ecboomies of 
scale, service orientation, broad ^plicability (they.* reportfthat 39 
states ^ad them), political and bureaucrat<ic legitimacy, and support 
from state or local funds. ^ (The study contains a brief -historical per- 
spective on* tf^jlpveloprlllht.of ESAs, but since it does not differ 
substantially- fmn Stephens's it is not summarized here.) 

The tijree REAs studied wer'e: the Wayne County intermediate School 
Di3trict, Wayne Coifnty, Michigan— serving 36 school districts; the 
Northern Colorado Education Board of Cooperative Services (NCEBOCS), 
Longmont, Co1orado--serving six* school districts; and the Educational 
Iffiprovement Center-South (ElC-South), New Jersey--serving 144 school 
jstrJcts. These were chosen toVepresent exemplary features of 
different REA- types. ' 



A relatively elaborate conceptual framework was developed for 
analyzing the data efBerging from the case studies. This framework - 
Specified three*types of outcomes of collaboration: direct godds^and 
services; .uti lization outcomes (initfation of a plamijhg activity^ 
changes in practice, changes in -attitudes, confirmation of effectjve- 
ness of current practice); and dysfunctional outcomes (addecht^ime; 
confusion of responsibilities). Th.e fraiiiework aiso hypothesised five 
alternative^ explanations for successful utilization . Successful coljeb-' 
oration might occur because it was accompanied by: (a) mutual exchanges 
betwe'fen the cooperating^agencies, (b) access to external funds, (c) 
m^nflates to collaborate from an external^source, (d) format" agreements 
between cooperating agencies, ;or (ei medn^tion, of conflicts between the 
agencies. ^Some personal contributions to success were also hypothesized 
(f) mut^ual exchanges between individuals within the'participating 
agencies, (g) cpntribution to personal or srelf-fiilf i1 Iment goals among' 
irrdi vidua Is,' and (h) career advancement for . individuals as a result of 
collaboration. * . # 
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The study examines the extent to which each REA resulted in speci- 
fied outcomes,, accompanied by one or mor^/ of the aboVe hypolfheses for" 
explaining 'success* That is, each*case was examined to sBe-what kind of 
outcomes resulted from collaboration; and each .situation producing an 
outcome was examined to/determine which, if any, of the hypothesized 
contributors to successful outcomes were present. This anlilysis was 
performed separately for three different knowledge utilization services : 
(1) staff development, {2} linker assistance, and (3) information re- 
tri'eval or dissemination. Yin and'^Gwaltney -label this methodology a 
"direct replication design." The data were collected through W/o per- 
sonal visits to each site and the review of a large number of documents. 

Before reviewing the conclusions of the analysis, let us note some 
representative outcomes from each of the sites; they provide specific • ' 
exaraples of some, of the work of REAs. 
\ / 

• Selected goods *and services^ outcomes were: semester-long 

•> workshops, training information and materials, on-site ad- 
vice, catalogs, answers to telephone questions, and NDN 
, products. ■ ^ 

^ • Selected utilization outcomes were: work'shops, consulta- 
V tions, 'and product adoptions. One REA estimated that 16,274 

persons participated in their workshops, consultations, and 
request services during^brie year;, another .reported 49 adop- 
, tions of 20 proclucts. ' ' . 

• Selected dysfunctional outcomes were: wor,ksfiops ^hat hati 

" ^ to be planned one year in advance and hence were not respon- 
'sive to new problems; facilities that were remote from users, 
thus reducing drop-in. use; a^nd part-time staff which reduced 
availability of ser\(ices. The authdrs speculated that fal,se 
starts were created by" the need for advanced .planning resulting 
from interorganiza^t^ional collaboration; had only a single dis- 
trict been involved, such false starts might have been reduced. 

- Of the five interorgamzational factors--(a) through '(e) above-- 
th^t wer'e initially hypothesized to contribute, to successful outc^&meS, 
three were found to contribute td-^thC^uccess of what Yin and Gwaltney 
called "simple arrangements." Those explanations that were instrumental 
in making simple arrangements work were: ' 

• The arrangement facil itated-ac^ss to external resources . Con- 
siderable tfnportance is place(i on^this Explanation by the au- ; ^ 

" ' thors. They not^hat 

♦irvterorganizational collaboration can be IteSt fostered 
% if, as a resuU'of t>e collaboration, the participating ' 

organization, can gain additional resources from arl 

externa] source. This situation should be'cliVectly coji- 
* ■ ^trasted w.ith an arrangement whereby users 'yfees are used 

to .support a service. -Bas^d on our threefcases^ the 
. ,latter situaiSpn dDes not seem to wok as effectively. 




t The authors found that when users' fees were involved (aS' 
opposecj to situatiojis in which funds were available from 
outside sources s^JCh as the state or federal government), 
desirable outcomes were .less frequently observed. They 
conclude that "in simple interorganizationa WrTang^emen^ 
\ fees for services will probably /6^nly work where ^one*' of the 

participating organizations offdrs a service that the otfjer 
'is incapable of prpviding for^self." 

t The arrangement produced a mutual exchange gf advantage to 
. the parties -invol ved > An example of such a mutual exchange: 
When LEA participants paid fees for a course, the university 
provided instructors arid course credit in return for^ increased 
enrollments, and the REA directed the design of the course in * 
return for administering and arranging the program. Although 
in ,some instances mutual exchange alone contributed to success- 
ful outcomes; the authors co/iclude that in the absence of access, 
to external resources, knowledge utilization outcomes were^not 
likely to accur* 

t The arrangement was 9 response to a- mandate to collaborate . 

. Such mandates were arranged, for example, when the' state re- 
vi^wed the budget of a particular REA. The authors conclude . 
that "all other things being equal ^a strong mandate can 
strenghtea a collaborative relationship. A weak mandate may 
undermine such a relationship." ^ 

Another unanticipated factor was found to contribute, to success- 
ful 'outcomes of 1 nterqrganizational arrangements. The authors found 
that continued Interpersonal communication between REA and LEA staffs* 
led to: increased awareness of the capabilities- and needs of eacff; 
contacts between st^ff, Independent of otcasions when specific problems 
needed to be solved; appreciation of constraints that existed between 
the organizations^; knowledge of resources available from both agencies;. 
and Identification of future^iefeds or capabilities. Interpersonal • 
^netwbi;ks were found to be fostered by: the existence of a strong gov- 
.erning board that represented both organizati()ns; communications'* by 
the REA staff In the professional organizations of the CEA; and the 
prior service of REA staff in a constituent LEA/ 

Another finding: Successful outcomes occurred -in envi'ronments ^ 
that werfr heavfly: "user-VesponsI ve. " This brient'ation was defined as 
involving: assessment of user needs; user parttclpatiOn in the design , 
of a knowledge utilization service; user sensitivity in the design-' of 
everyday service operations; development of a user-o^ientfed. knowledge 
base; user-or1ented manners of providing implementation assistance; and 
fol low-up^procedures for assessing user satisfaction with services. 

In complex organ izations--those in which ^ervice^ go beyond knowl- 
edge utilization actfvitips to include what^the authors term "inter- 
governmental functions"--mutual exchanges appear tp^be significant. 
But the sityation is ^further enhanced when the SEA imposes "congr*uent 
conditions" on both the REAs and LEAs {ma/idates tQ both REAs and LEAs 
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that support interorganization cooperation in matters related to 
knowledge'^utilization). ThusI in situations like the Colorado REA 
studied, where the SEA does not impose or mandate such conditions, 
success is less likely. The authors note, however, that this mandate 
must be installed for a sufficient period of time so that collaboration 
can occur; year-to-year changes in the mandate might be dysfunctional. 

In summary, Yin and 6waltney found that access to externaTvre- 
sources is critical to interorganizational arrangements that facilitate 
knowledge utilization. It is also important tO encourage interpersonal 
and interorganizational communications, including recruitment of nev/ 
staff frorrr client populations. And third-party organizations should 
recognize the potent effect of their actions on interorganizational 
arrangerflents. 



J. Frankel , L.J. Sharp, and A.D. Biderman. Performers of Research and 
Research-Related Activities in the Field of Education (1979). 

0 



This is a report on a study of organizations performing research 
and .development work in the field of education. One purpose of^'the 
study was to create an American Registry of Resear?ch and Rese-arch-'^ 
Related Organizations in Education (ARRGE). This summary concerns only 
that portion of the effort focused on information about intermediate 
service agencies (ISAs). 

As part of the data collectibn for the ARROE directory, a number 
of ISAs were surveyed. Subsequently, the registry listed 193 such. ^ 
agencjes conducting any of the following types of work: establishing 
new facts or principles (research), inventing new or improving existing 
solutions to educational problems (development), assessing the effects 
of/?^xisting programs or determi^ning the feasibility of new, ones (evalua-. 
ti)st^Jt/^ R&D results. (Thl^acronym RDD^E was used for ^ 

this sK.^^functions. ) The ISAs studied v/efe part of a, larger group 
of agencies within the public sector (as.distingui shed fr'om the academic 
and the private sectors). Altogether, '1 ,530 organizations were listed 
in the. register. Sixteen percent of the staff and 15 percent of the 
funds for R&D were found to be in the public sector. Within that seg- 
ment, Frankel et al. report that $26 million was devoted to RDD&E by 
ISAs; this represente'd four percent of the total national ROD&E effort 
in dollars. ISAs had 1,600 full-time equi val ent. professional s primarily 
involved jn RDD&E. 

\ 

• The 'study reports that 163 agencies spent in excess of $1 million - 
each for education RDD&E; among this, group v/ere six ISAs. But a majority 
(51 percent)^ of the ISAs spent less than $50,000 and over 90 percent 
spent less t'han $500,000.. One third spent' less than $25^000. The me- - 
dian number of FTCs in an ISA responsible for RDDSE was tv/o; within any 
particular institution, at a sub-organizational leVel, the median number 
v/afs one FTE. Thirty percent reported that none of their ful 1-time pro- 
fessional staff were involved in RDD?<E. However, 17 agejicies reported 
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employing 20 or more full-time education RDD&E professionals, Four of 
the 10 ISAs spending more than $500,000 were .irr Pennsylvania; two were 
in Michigan, ' ' 

- Research, as distinguished from the other RDD8E functions, was 
most heavily emphasized in the academic and private sectors, whil# 
development and evaluation studies dominated the contribution of the 
pubrlic agencies, Disseoifnatiort emerged as the area pf lowest emphasis, 
receiving the sma^llest allocation of funds by performers except for 
state agencies and large public school -systems. Public agencies were 
heavily involved in curriculum issues, the needs of special student 
groups, and enrollment and demographic analyses. Presumably, most of 
the ISA effort fell in the development and evaluation areas related to 
these issues, • . ' 

Th4 Study indicates that 53 percent of the* support for all of 
RDD&E carae from fedeVal sources; what the percentage was fm^ I$As was 

♦not reported. Bat the authors note that much of the work oK^tate^ 
agencies and of the large sctiool districts is federally funded and 

.therefore vulnerable to cutbacks and discontinuities. We assume this to 
be true of ISAs, 

4 i 

Ln their conclusion, Frankel-^et al^ argue that the smallest RDD8E 
effort was made in the^public sector and that much more activity should 
occur there if RDD&E activities' are to reach a higher level of acceptance 
by practitioners and local policymakers. The authors point put that 
^when research is conducted by "outsiders," a perceived gap between the 
researcher^and practitioner develops, making it more difficult fo/ R&D 
results to be adopted, " ^ 
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Comparative Analysis 

The Stephens study contains a mass of demographic data about 316 
educational service agencies. Its strength lies in its documentation 
of. the existence of tbese agencies in terms of their numbers, their 
individual sizes, and the extent to which' they are involved in most 
aspects of -education. The study swrely indicates that educat^ional 
service aqencies should not be, overlooked when it comes to most oper- 
ational aspects of the educational system. By Stephens'^s count, there 
are nearly 1,000 ESA units in the 26 states examined, and since there 
are other states with ESAs of some type {^in estimates from a previous 
study by Stephens that 39 stages have some form of ESAs), they are too 
numerous to ignore. ^ 

It should be noted in passing that both the Stephens and Yin ^ 
estimates ^of th^ number of ESAs in the country disagree with the 
frgures reported by Frankel et al. in the ARROE study. The latter 
researchers identified only 193 ESAs in their data base. Given that 
they define R&D activities broadly to include the invention of new 
or improved solutions to educational problems], the assessment of the 
effects of existing programs, and the dissemination of R&D results, 
it ^^ould seem that many, many more ESAs shoujd have been discovered. 
One must conclude either that the ARROE study significantly underes- 
timates the number of agencies involved; or that Stephens's and Yin's 
pbservations about the potential for ESAs in knowledge utilization 
and dissemination should be modified. We hope that someone will 
either compare the Stephens and ARROE data bases or, if that is not 
possible, gather new information. ' 

One drav/back to the Stephens study is that, even with tfte mass 
of data reported, we are left without a sense of perspective. What 
Is the total number of these units nationwide? What percent of th€ 
nation's schools are served by ESAs? What percent of the students? 
What percent of the educational dollar is spent on ESAs? Although 
these comparative questions 'go beyond the explicft scope of the Steph- 
ens study, it seems unfortunate, what with the great energy that was 
spent in collecting such a mass^of data, that they could r^ot have been 
apswered. In contrast, the Yin study by de-6ign presents aTniost no 
information regarding the scal>e and 'scope of ESA involvement in the 
totality of educational operations. But even in the absence of this 
comparative information it is possible to infer from all three studies 
that^ individual ESAs have varying impact on the local schools they 
serve. They should hot be considered a monolithic group of agencies. 
A sense of the differences in functions among ESAs can be drawn from 
Stephens, Yin, and jto a limited extent^he ARROE study. Stephens 
develops three categories of units; Yint&c.uses on an example of each. 

. 1. The special districts (for instance the Wayne County 

♦ IntermiBdiate'District studied by Yin) are large-scale « » 



operations involved^ in almost all aspects of local educa- 
^ tibnal practice; their sources*of funds are equally broad, 
with a relatively small proportion coming from local contri- 
butions for services. These units are heavily involved in 
instruct ion--not only providing services to assist others 
* in instruction, but carrying out the instruction themselves 
in particular fields like special and vocational education* 
(The Stephens study of the Texas educational service agen- 
cies is wholly consistent with the portrayal of the Wayne 
County Intermediate School* District)* 

9 

2.. The regionalized educational service units (such as'the 
New Jersey Education Improvement Center-South) are not 
involved in such direct ^instructional practice*- They 
concentrate on quality (Control from a managerial and reg- 
ulatory perspective, in some cases assisting in the direct 
administration of state'regulations. Their local school 
involvement takes the form of management,, staff develop- 
ment, and information .services. (In some respects, these 
represent the purest form of school improvement services 
as defined by Yin. ) ^ 

« 

' 3* The collaborati ves (such as the Northern Coloradg Educa- 
tional Board of Cooperative Services) do not engage in 
widespread instruction (though some provide very special- 
ized broad services to. the handicapped), but they do get 
involved in the operational aspects of local schools pri- ' 
marily through admini'strative acti vtt4.?S>-payron , for 
example. At the same time, they work extensively in the 
improvement domain, but for the most part without in- 
volvement in ? state's regulatory activities. (It should 
. be^noted that Yin misleads the reader slightly by implying 
a formal, vertical relationship between schools, coopera- 
tives, and state education agencies. In most cases the 
cooperatives are the creatures of state legislation, but • 
have little or no formal relation with the state education 
agency.) 

A 

In the li'ght of. their differences in nature, we agann assert that 
these \inits must not be treated as though they are all the same and can 
perform the same functions. Not only are they dramatically different i 
size and outreach, 4:hey simply^ do not serve the same purposes. 

Given this diversity, what can we conclude about the potential 
role of these agencies in school improvement? To gfet at this question, 
we must examine several' sub-questtons: 

< • 

• Are ESAs better suited tp some problem areas than 
others? , 

• What functions caracied out by these units hold * 
"potential for school improvement? 
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t Given these problem areas and functions, what is the 
I'evel of resources" available for work on school im- 
provement? (We will address'this question. a'/ a sub- 
sidiary of the previous two*) - ( 

t What are the primary constraints o.r limitations that 
must be taken into consideration? 

These questions will be answered only in the context of the studies 
reviewed. 



1- Are there specific problem areas^to which ESAs are particularly 
suited? And what is the level of resources 'available? 

One area that would not be a likely one for school improvement 
is that of educational equity--at least in the sense of the involve- 
ment of women and minorities in educational practice. Given the 
white/male composition of the boards and executive rosters reported 
by Stephens, one must have doubts that the ESAs represent a major 
potential force-^EoT equity of educational opportunity* Perhaps, in- 
stead, we should look on ESAs as fertile groupd for building addi- 
tional capacity in this area* 

One area in which these' agencies have considerable expertise stands 
out clearly: special education* As reported by Stephens, , fully one 
half of the personnel in ESAs (20,000 FTE) are^working in this area 
already. We do not know what percentage of the total special education 
workforce this figure represents, but we assume it *!S significant. In 
a(Jd1t1on, 34 percent of the ESAs' budgets ($282' mil lion) is devoted to 
special education* 

t - 

Ten percent of the FTE workforce irg|ESAs, according to Stephens, 
is employed in vocational education. Agein, we assume that this is not 
an insignificant part of the total vocationaTeducation workforce^-^Four 
teen percent of the ESAs' budgets ($199 million) is spent on vocational 
education. '\ 

Six percent of tt^p FTE wprJcforce is devoted to adult education. 
Expenditures in this area were not reported. 

Eleven other areas are represented by FTE figures of l/ss than 
three percent<^each* Hence, we assume that if major nationwide im- 
provements weVe to be undertaken- in proi^lem areas other than those 
identified above, considerable capacity building would be necessary* 



2. What functions for school improvement do ESAs perform that offer 
the greatest potential for school improvement?' And what is the 
level of resources available? ' ^ 

Knowledge utilization functions * The Yin stu.dy focuses. on knowl- 
edge TiFrTizaTioFTun^ represent one major area in 
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which regional service agencies can contribute to school improvement. 
Yin defines "knowledge utilization" in a manner compatible with the 
idea of school improvement: external knowledge disseminated and used 
to bring about a variety of oiitcomes, including changes in practice, y. 
He identifies staff development, linker assistance, and inftjrmatiorr/^' 
retrieval as major services directed toward knowledge utilization/ On 
the other hand, the Stephens data indicate that these activi tiesMzon- 
stitute a modest portion of all the services provided by ESAs. /For i 
example, Stephens reports that staff development is supported tty the / 
efforts of daly 264 full-time equivalent people out of a 40,633utotal/ 
FTE. Information services are supported by the efforts of only r4^' 
persons. In addition, Stephens reports only 258 research and devel- 
opment FTE. All of these workers com^ned represent less than two 
percent of the total FTE in these agencies. 

One confusing note on the extent of th^ workforce dedicated to 
knowledge 'utilization: Frankel era), define RDD&E to include t-he 
same concepts as does Yin (though Ff^ankel extludes v/orkshops--a pri- 
mary form of staff development). One'presumably should be able to 
add Stephens's categories of research and development, information 
services, and evaluation (although Frankel rules out staff evaluations 
tions and student testing--type5 of work probably involved in Stephens' 
categories) and come up with a figure roughly in agreement with Fran- 
ker s tally of the knowledge util ization- workforce. If one does the 
math, however, the result is 532 FTE— far short of the 1,600 FTE cited 
by Frankel. The figures ar^^even more out-of-joint considering that 
Frankel counted personnel i'rr only 193 agencies while Stephens worked 
with 314., Clearly, the data from these sources needs, tp be clarified. 
But .even tteing the higher set of figures, one finds a relatively small 
number of professionals working in the area of knowledge utilization 

or research\and development. 

■ » 

Judging the potential of this group for school improvement re- 
quires making assumptibns about the person-power needed to implement' 
a knowledge utilization strategy for a large number of sctiools. Frankel 
would argue that, to the extent that the R^iD functions going^on in ISAs 
ar6 largely "disseminative" in nature (that is, knowledge utilization, 
«not knowledge production), and to the extent that dissemination is the 
area of least emphasis in the national R8D picture, receiving the small- 
est amount of allocations-by most performers- -to that extent ,' knowledge 
utilization is more a potential for school improvement than it is an 
existing resource. » On the other hand, at least in the cases cited 1)y 
Yin, no matter how small di^mination allocations were as a percentage 
of the overall effort, theyVid result in significant outcomes. Other 
federal dissemination programs exhibit a similar leveraging; the Na- 
tional Diffusion Netwprk comes readily to mind as an example* However 
the case is argued, it seems certain that of the resources currently 
available to schools for knov/ledge ut4vrization, a significant portion 
now exist in regional service agencies-^ fact that policymakers should 
not ignore. ^ \ 

. Curriculum and instructional service, functions . Curriculum and 
instructional^ services might be considered a subset of knowledge 
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utilization or RDD&E functions* Yin, by subsuming staff development 
within his categoryof knowledge utilization, appears to opt for the 
inclusion. However, grankel explicitly excludes staff development from 
RDD8E (although she would include development of new programs-). No 
matter; curriculum and instructional services- seem significantly dis- 
tinguishable from other RDO&E functions to be examined separately. 
Activities in this area range from the consultation work of specialists 
in traditional areas such as reading, language arts, math, and science 
to- special projects charged with developing new or better strategies 
for improving instruction in such areas as gifted and talented, migrant 
education, bilingual education, outdoor/environmental education; etc. 
It is difficult to get a fix on how many people provide these services ^ 
or how much money is spent providing them. Stephens is our only source, 
and because he combines such functions as direct instruction ^nd cur- 
riculum support services in his program areas, it->is difficult to make 
an estimate of the magnitude of effort. We v/ould guess that it is of 
about the same magnitude as (or only slightly greater than) the knowl- 
edge utilization effort--a fairly low level of effort. 

0/ie's assessment of the policy implications OT^sing such limited 
curriculum, and instructional resources for school vim^rovement depends, 

.to a 'b;pnsiderable degree, on one's assumptions about the potential 
role 0^ curriculum change in school improvement. For example, there 
is a s^timent in some policy circles that curriculum reform is not 
likely to result in major changes in student achievement. If one holds 
that view, then the presence of curriculum and instructional services 
functions in ESAs will not appear to hold much promise. On the other 
hand, to the extent that curriculum and instructional services are 
valued, these services will be considered to offer great potential for 

, school improvement. 

As budgets have been cut at the local and state levels, curriculum 
and instructional services have been among the first to go; it may be 
that cooperatives and regional service agencies are the logical \locations 
for such services. But they may al so' disappear rapidly froni regfGmal 
agencies if they are financed primarily with federal dollars (a&^Ji^ sur- 
mise they are). The. greatest changes for regional agencies may come in 
tijis area. If they are now funded largely by federal resources, most of 
those resources will go into the new block grants. Whether the state 
will continue to operate these agencies is a matter of considerable 
policy importance. 

* 

Supplanting functions . In -^addi t idn to the obvious areas just 
identified, there are several others that hold school improvement op- 
portunities for regional education. One of the most important, v/e think 
of ^ a "supplarrti ng"^ function; that is, in some areas, instead of 
assisting sciiools in'carrying put their work more efficiently, regional 
agencies directly carry out the .vvork themselves. Most obvious among 
these supplanting funct1(^s i§ direct instruction. To. a considerable 
degree, the ESA systems in tt\is. country are direct instruction units. 
This can easily ^be deduced fron>/the fdpt that 59 percent of the full- 
time equivalent staff are,e1th;er t^chen^ or teacher aitles. Available 
evidence indicates 'th^t' the bulk- of/ tTiis , instruct ion is teaching of the 



handicapped (and to some extent adult and /vocational education). 

The issues of school improvement in this area are the issues of 
improvement of instruction ip general. There is nothing unique about 
teachers who happen to work for a bureaucracy called an "educational 
service 'agency" instead of a local school* In' ot(|^er words, whatever 
policies might be effective in improving instWction in schools will 
also apply* to ESAs. ' * 

Another supplanting function is the regional service unit prac- 
tice of directly conducti ng^ pupil/personnel activities (guidance and 
counseling, testing, diagnosis, etc.)* To the extent that -these ser- 
vices are a part of ESA activities, they become a ^potential target for 
Ifflprovemfirrt just as they would in a local school. 

' ^ . Admi/ii strati ve operations . Regional service units perform impor- 
tant administrative operations for local schools; Stephens's data tn- 
'dicate that as much as six percent of the PTE is dedicated to these 
services. These operations range from joint purchasing of toilet paper 
to the management of payrolls and employee records, to the operation 
of school buses* (The last item probably makes up a larger percentage 
of budgets than reflected by PTE data, since the cost of maintaining 
and operating a fleet of buses is quite high these days'.) The role 
>these administrative operations play in school improvement may be neg- 
ligible except to the extent that greater efficiency in administrative 
operations frees up more money for the instructional program. The role 
of regional service agencies in bringing about greater efficiency of 
operation is always mentioned aS one of their unique contributions tp 
the educational system. Surprisingly, however, no real data has yet 
emerged to document this phenonj^non. 

Governance functions . This area includes not -only the relaj:ively 
small proportion of people involved in administration (and probably 
only a small percentage of those Stephens lists as involved in admin- 
istration have much of a part In governance issues), but also those 
wh6 serve on advisory boards and those tied to the governance of ESAs 
through^ linkage with state and local education agencies. These people 
represent the establishment in educatit)n- -certainly, at least, in those 
states with a st^te-wide system. Here the potential for improvement is 
probably greater than is currently realized: Reaching the people in- 
volved in CSA governance amounts to reaching a significant portion Qf 
those who now operate our, educational system. Viewiag the ESA as a 
communicattbn link with these people has th'e advantage of blurring 
scfme traditional lines of protocol. For examplfe, the federal govern-^ 
merft ha^ difficulty speaking directly to local school districts with-' 

out filtering, through the states; by using the ESAs* as one channel 

for communicatiorToi^ topics related to school improvement , it would be 
possible to reacn a much broader atjdience'* Certainly this channel 
could not be used for of^fic1«l, regulatory .communications without im- 
punity; but it could be used as 'a vehicIPe far awareness, debate, 
feedb^k, and mediation between the schools and the state and federal 
governments. This is, in effect, what Stephens defines as 6ne of the 
ESAs* major strengths. Yin recognizes it too when ^e.s-peaks '^of the* 



mediating functions of REAs. In particular, yin*s exposition of the 
importance of mandates and the imposition of ^congruent conditions" . 
--mandates to both REAs and LEAs that support interorganizational, 
cooperation— raises important pol icy implications: To the extent that 
regional service agencies arp part- of a deliberate mandate from tfiird 
parties (such as state education agencies) to bring about school im- 
provement, they are ipore likely to succeed*^ Yin argues that to the 
jjegree thart states separately ask local schools how they are using 
regional units to improve themselves, and simultaneously ask regional 
units hov/ they are helping schools, it is more lik'ely that collabora- 
tion leading to improvement will occur. And if this discussion 1s^ 
held in the context of the allocation of -federal or st-ate resources, 
it is even more likely to yield beneficial schoal improvement outcomes* 

finance systems . At no time do any of the studies reviewed speak 
of the potential role^of regional units in the equalization of school 
. finance resources. In fact, most regional units do not nov/ play such 
a role. But there are exceptions. For example, in New Jersey's system 
a school district deficient in providing a "thorough and efficient" . 
education to its students can acquire the additional state resources 
for improvement through one of the regional Educational Improvement 
Centers. It seems to us that more use could be made of the regional 
units by employing them as vehicles for distributing additional state 
resources where the need is the greatest. This might be a particularly* 
appropriate tool for responding differentiaUy to ur^gual rural and 
urbamneedsl 



3» What are the primary constraints or limitations that need to be 

taken into account .in using regional service Onits to improve eduta- - 
tional practice^ - 
* 

The 'constraint mokt important, it seems to us, is-that focused on. 
by Yin in the content of external resources. He -indicates that suc- 
cessful cqllaboratio^n and hence successful knowledge utilization ^ 
occurred when external resources were ma^^vailable to the cooperat- 
ing parties that would not have been ava^ble to any of them alone. 
Yin chal lenges^the idea that school improvement services are likely 
to be bought from regional service units by local schools. He found 
that when this was a condition of collaboration, it was not successful. 
Only, when both parties^ could cooperate to gain new resources and/or 
e)<thange benefits; dicl successfi^ knowledge util ization through inter-^ 
orgaVizationaV col laJ)oration occj^r. ^ ' ' 

To a certain extent, Stephens's data/support a similar conclusion* 
Federal dollars seerrTto be mpst involved in the functions we have' de- 
scribed that •tiave^the mos^ potential for Improvement. Federal dollars 
are not involved', for* exalnple, in administrative operations.* They are 
not heavily involved in many of the drrect "instruction functions. They 
are extensively involved in knowledge utilization activities and cur- 
riculum and instruction services. The conclusion seer^s to be thatT if 
regional units are to act^as vehicles for school improvement, they must 
be given the opportunity^ to assist the constituent LEAs in obtaining 



resources they would r>ot otherwise have been Jble to get. Such re- 
sources may not be large in relationship to the totaV scale of the 
regional service units' operations, but? there must be soin^oney there 
to act as a catalyst. It would.be an error to think of. this money as 
"seed nK)ney"--money that once deg^loyed starts a self-sustaining effort; 
instead, it must be thought of as a continij^iag ^source of "starts" fo?" * 
school improvement efforts. Given the current policy of removing the 
federal governmer\t from this role, if state governments do not create 
this source ((f incentive for interorganizational collaboration, most 
school improvement functions of regional service agencies would appear 
to be doomed. , 

One other constraint: It should be noted from the Stephens data 
that a preponderance of ESA PTE energy is located in two states-- 
New York and Pennsylvania. Together, these two states*6ontribute 56 
percent of the total PTE of all ESAs studied. Adding Michigan's 11 
percent reveals that 67 percent of the entire 26-state effort is in 
these three states. This raises important questions about the gener- 
al izability of ES/\s as a nationwide resource. Another constraint tin 
using ESAs on a national basis: They do not, in general, service the 
private sector. 
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• * • ,^ . Policy Xonclusioris ' " / ' 

. • * • U ^Educational service agencies are a s4gnificant element in th^ . ^ 
nation's educati^onal conf igunation. Well over 1,000 are in existence, 
lopated in a majority of states. Jhey^do everythjng from tea^hihg . 
children (under contract arrangements with U)tal sctiools) to cooper-- . i 
^ ativeVy buyi ng buses. They beep p^ayrolls, conduct^staf f development,' 
. ^ 2^ evaluate programs and students, and do long-raqge planning. . They .should / 
^ - not be ignored by any federal policy or program that propose s to affect 
. public education • : ' 

'2.^ ESAs are tJi'verse' in ttretr fuKcttons, size, and governance ^ 
structure as they are in 'their names:* boards of cooperative services, 
educational improverifef^ centers, educational service centers, interme- 
diate -units-^a-nd manyTTiore. Some are formal regional seryice^branches 

- " of state educatjor^ agencies; others^.fjjnct ion by' contract; with quasi- <^ 
' :> ^ ' ' ^offici^al ^ajictionT others are independent Cooperatives' that do. not ' ^ ^ 

' * answer t^ staire^^^cation agenf.lejJ Federal policy must^be informed * 

^ 'v i by^this diversity>\ Polioymakersym^ not assume tliat all ESAs can be' . , 
. ' ^eacrrec^^through statisj education^^agenctes, and musit take into account 

ESAs' -diffg»Cng interests and cap9biU^1es. More information -on these 
, / . - . . ' agencies should be disseminated broadly throughout g^verfflfent at the ' • 

- , ' warking level. i ^ ~ ^ ' ^" I 

• .3. The ESAs' pot&ff^^ for school inipr#vemenf Is both substantial^ 
' an* limited: * * ^ 




. ' a.^ There' are c^ertain^areas, ^such as special a*nd-/voca- 
/ti-Onal educ'atioh, where almost all eTOationaV 
' ■ ; / service , agencies. have expertise. Many individual 

agencies hive expertise in other ar6as, as well. 

■ . b. The. bulk of the operatlpns in many agencies' sup^' 

. ^ • plant local-, instruction;- the ESAs actually hiVeUhe 

* teachers, and' select the studgnt? In such areas as 
specif) and vocational education..- As a result, they 
are th^selves calrdidate targets foic sdhool Improve- 
; ' *v ment effort s . ^ . ^ 



' ^x.;-ESAs already perwfo^m a krge -number of the nation's-, 
.knowledge utilization functions; they^operat-e st^ff 
^ , ^ . development, linlj^r assistance, ciisseminatiort, anc^ 

\ r /irifoniiation^servfices suQii 'as thpsi sp6ns(^ed'^y. the 

' - ^ ' National Diffiis^^n I^twork. • 



d. .ESA^ alsa pV^ovide^o schools a large- "array of cuf^ric-* 
ulum setvices--e.g. , curriculum development and expet-. 



' ,\ • , ^ Imental programming.* In particular, they. Jb^ye' been 

•\ ^ ' * / .arpcTnej the elements of the educational* system most ' 




ERIC 



responsive to mandates, in career education, programs for 



the; gifted and talented, environmental education, etc. 

'a. 'ESAs carry out research and evaluation^functions, 

Iffcluding program evaluation and statistieaTanalysi s 

of school characteristics^ 0 , * 

f. ESAs perform a vtfriety of administrative services for 
schools. Although.,this area probably has limitecj 
-pptential for school' improvement, the cost savings of ' 1 
these operations (though undocumented) surely contrib- 
ute to the im.provement of a system so influenced by - ^ . 
declining resources. ■ . ' , 

• ^ g. -Because their governance structures tnV'olve^all levejs 
of the educational .system (except .the federal) irt many 
states, fSAs have potential as informal communications 
channels for enhancing awareness oAneeds, issues, and 
improvements in education. , * . • 

Although^ their supplanting and adrpinistrattve functions constitute the ^~ . * ^ / 

largest elemgnt of thgse -agencies ' operations (as. measured by FTE cand 

by dollars expended), the other functions mentioned above are edngide'r - 

abJe enough ta represent a significant capacity for educational inipro"ve - ^. 

roent; this should be understood by the federal governments t> ' / - * - ^ 



Some limitations'-should be noted: / ^ / . , ^ 

h. ' The ESAs' supplanting^«rf l^Qai jfi^sitrU<::6^io/> is of such-- ' ^' 

scale 1?i three states 1[(^ew.'Yon9r''Penn"syl vania,^ and * - * 
^( l«)i(shigan) that these states make up over two thirds of 

® the total* system; as measured by FTE and bufdgets. But 
^ this lopsidedniess in supplanting functions does not-* 
seem to extend 't6 the other school improvement func- 
.tions identified.^ ^ . ^ 

i. The .governance structure and executive positions of - 
/these Agencies are dominated by males and Caucasians" 
(about 98 percent). Whet^^c^^lrls .results in a bias. in 
programming has not been determined--but it does sug- 
gest an area 'In wh-ich some improvement is possible. 

ons of geographicaV and equity imbalance n^ed not>be*an ^ 
ntable obstacle J:o the ihiproveftient re^s of these agencies. 

4. Harnessing the resources ^of these agencies appears to hipge on 
the avaflabiVtty of. money outside the local' or regional agertties. Sue-' 
;cessfuj knowledge utilization functions apparently cannot be based on 
.local contributions.., S^ ^te oriajjag^l monies are the "key to ESA's^par- 
tfclpation in the improvement'>*pp<fcess. ^ Given the impendi*ng cutbacks in 




federal resourced in this area agd the transfer 6f the remaining funds - ^ 
to th^ statesy the futiire of these regional educational aaenciesXancT ' 
hence their roles in the s,chool improvement process) ts^ clearly in doubt. 
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Overview i 



This^pape^ is a review and synthesis of'several fexisting docu- 
.mehts.^ Its Anxent is J:o distill from tJiese documents knowledge 
regarding regional educatj..on^ laboratories (RELs) and university 
^ce.nt6rs and their dissem1n^tioh\and school .improvement efforts. Th6- ~ 
paper is presented in* three sectfdns. The first contains brief, 
analytical descriptions of the reports reviev/ed. The second section 
is a •propositipnal overview^ of the 1essons*learned from comparing 
and contrasting these reports. ' Jhe "third constitutes a brief set of. 
recommenda t ions that grow out of the preceding two sections. 

Data from the reports reviewed will be augmented by the author's 
badcgroLind' knowledge, the major argument that will emerge is, in fact, 
a relatij/ely simple but highly compelling -one: In the area' of, school 
improvement, organized capacity for probl^ solving is iniportant; or- 
ganized capacity does not'guarantee that high-quality wprk will. be done 
but makes it far more lively; hence, higH-quality educational research 
and development ^'s** needed for school improvement. 

The author urges that an important p6int be kept in mind during 
this .discussion. The organizations here considered wij.l be referred 
ta gen^ically as "lab^and centers." Most federally funded labs . 
and centers are part* of the Council for Educational development and 
Research (CEDa1?)4 but not all are members of that organization. The 
several reports reviev/ed that discuss labs and centers focused^ only 
cTp^ CEDaR members. But the arguments developed^^here are applicable 
beyond- the CEDaR membership .(e»g», they might be brought to bear op 
the Instii:ute for Research on Teaching at Michigan State University 
•or the Center -for the Stpdy'of R^eading at the Uhi versity of Illliibis). 



Section I* Reviev/ of Selected Reports 



c 



R. Campbell et aU R&D Funding Policies of the National Institute of 
Education:^ Revievv and Recomniendatlons (19757] 

This "report, popularly known as "the Campbell Report" (for its 
principal Consultant, Roald Caropbell), was published in September 19>75 
following three months of intensive work by the consultant group. NIE 
and'NCER (the National Council on EducationaJ.^ Research) had charged this 
group wi.th "evaluating the Impact* of [educational R&D funding] policies 
oa the nation's educational R&D system, with special' reference 'ta the 
regional educational laboratories and research and development centers 
es'tablished by the government in the 1960s" '(p. !)• Data for the report 
were acquired through; • * » , - ^ 

t a meeting v/it*h lab and center representatives and the _ 
,'§p(ecfliiv| director of CEDaR^ ^ 

• questionnaires sent to all labr and centers; * ^ 

• meetings ?&ind^tntG^ews with NIE staff; . . 
J % visits to selected R&D institutions, CEDaR members, and 

others; ^ - 

^ t extensive individual contacts' with "nnowledgeables" in the 

• field; 

r • a review of available literature; and - 

• the *col lective expertise 'of the consultant group. 

; Desftite its general title, the report focuses heavy emphasis on 

Idba and centers. - It is apparent that the consultant group felt com- 
pelled to scrutinize this particular set of organizations within the / 
.context of (1) dwindling funds for the NIE arid, .(2) allocation of an • . 
increasing percentage of NIE funds %o these organizations. 

The consultant group noted the "ir?flatied hopes of 'the 1960s and 
the pessimist 'of the mid-seventies" (p. 6), pointing to pivotal char- 
acteristics of i'nquiry'in the fields related to education. / 

/ § As In other homan-service fields, demands for pure * service ^ 
/in /education. always exceed available resources^ thus the 
linevit^ible need"for. continuing justification for allocating ^ , 
* \mds fof other purposes, e.^g.*, R&D. , 
. • r 1 ' ' ■ • V 

" - . § American public education is not' centrally controlled^, but ^ , 

• is open, \^ltiera.ble arrd^^omplex, and therefore k-nSwl^dge, 
% ' > whicti is in rts nature-tentative, will not' be universally 

^ ' .'applicable and may appear a weak tool arffong others contenders, 
" when school improvement is the focus. • ^ • . ' . - 
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t K'nowledge is not self-executing but requires implementation 
and the desire on the part of those implementing to achieve r 
the results implie<;J by the knowledge producers. 

f Finally, there will be no single "breakthroughs" or sudden 
panaceas, (pp. 6-7) 

I 

'On these 'groun-ds, the group Counseled restrained expectations, but at 
the same time urged continuation of the effort to improve education 
through knowledge-based inquiry. * 

* * 
Against this background it is well to ask whether invest- • 
ments in this difficult field. are worth the money. The y^: 

* only possible reply* is that we must keep plugging av/ay at. ' 
the difficult problems of learning and tea'ching and that 
doi^ng so by orderly scientific' inquiry is almost 'certainly 

* better than by hupc^. - (p. 64) „ ^ i 

The r*eport details the resources for educational Md available in 
1975. I*t 'has a chapter on the context for policy making at NIE as well, 
and janother on current policy directions. - 

The consultants assumed a highly critical •s.tance toward N^'E, find- 
ing the Institute's shifts in policy, and direction vis-a-vis organiza- 
tions in the'field destructive to organizational capacity. The con- 
sultants alsio paid particular attention to the lack of a reasonable * 
concept of dissemination arjd ensuing activities within; th'e Instituted 

We understand the political prefSsure for di sseminatton of 
. the. results of R&D, but we conclude- tlvat NTE has done little 
to a^ack the problem as a substantive matter or cluster of 
issu^ and* competing cpnceptual iziit16ns. We do not think 
that work In t\]e field can be halted until theory catches up, 

' but we. do believe an experimental attitude would, be helpful 
even as action goes /orwarck, and thSt diverse groups v/ithin 
N'IE could be brought together more directly to consider 
paradigms for change and;the various roles of dissemination 
within them? Research on knowledge utilization could be - 
more ext.ensively fupded as an essential basis for* policy in 

' thls^area. ^ (p. 66) \ ' * . * . ^ ^ * 

The report a-lso cons'^iders the^ ne^d for NIB t^ view state and TocaJ edu- 
cation agencies as R^ID 'performers, "not mere recipients or beneficiaries 
of others\„ v/ork" (p. 12); to significantly fund basic research, not. s,imply 
-"snjuggle'^it^ in (p. 1,7); and to pay. special attention to expanding train- 
ing and apprenticeship opportunities for v/omen and minorities (p. 75).^ 

In several places^ it is nol^d that inxJivldual staff membeVs o^ 
the .Institute were thoughtful, hard-working, and innovative in their 
approach to. ideas, and that they were, helpful to the consultant group as 
»1t cornpiled its report.* Hov/ever, assessment of NIE as an organiz'ation 



led the consultants to serious questions regarding coherence and 
effectiveness, and in effect, the whole was found to be much less than 
the sum of its p^rts. 

^ . . . / , 

< / 

The consultant group found the then-existing labs and centers to 
be a highly mixed group of organizations varying widely in purpose and- 
quality of work. Noting the diminution fn the number of organizations 
established throughout the sixties, the report's author? concluded that 
"ther^ may have been more success in eliminating marginal institutions 
or at I6ast ending their substantial federal support than success in 
^improving the quality of work at thase remaining" (p. 69). The group., 
noted that directors of labs 'and centers did not expect .institutional 
suppof-t unrelated to performance or the relevance ^of their work. Based 
on thesp findings, the consultants suggested that some , existing labs aild 
centers (perhaps six to eight, .perhaps fewer);be designated as national 
laboratories--a set of "high-quality institutions vith^vhlch INIE] will 
work, very closely to' carry out its^ missions^ managing them tovzards goals 
the agency and th^ institutions'can comfortably share" (p. 69). The- 
study also concludes that no more than one third of NIE's program funds 
should be allocated to ^ese special institutions and that, overall, ex- 
panded funding for eduelitior^al RSD was at the tinie essential.. 

In sum, the Campbell report is .larg^el^ (albeit constructively) ^ I 
critica"l of NIE; expresses misgivings about the quality and performance 
Qf some labs and centers; and is^particglarly concerned about^e'^ob- 
lam of dissemination. ^The report recommends that NJ£_establTsh^a few 
national laborattyies ^nd, in addition, 'v/c^< mor.e closely and colVabo- 
ratively. with state and local education a^&rreijg's. Clearly, tjie writers, 
of the report felt labs and centgVs to be important 'tools in the pro- 
cess^ of "improving schooling. But' they -alio felt tbat reorganization, 
was ialled for at the? time. * ■ s ^ 



Panel for the Review of Laboratory and Center Operations. Research and 
Development Centers and Regional Educational Laboratories: Strength - 
ening and Stabilizing ^National Resource (1979). ^ 

I . . ' 

^ Three, and one half years after Campbell'' s, in January 1979, there 
appeared this study commonly known -as "the Panel Report." It was the 
work of a panel = created in August 1977 at the behest of Congress, which 
mandated the r^eview panel {membership to be appointed by the director 
of fflE) as part of the Education AiWidmants ^of 1976. The panel's work 
vas conducted between September 1977* and vJanuary 1979 when it issued 
its final report. Subsets of the panel visited each Jab and center; the 
report contains detailed accounts of -the* site vj^sits. *lr\ addition, 
chapters detail the history of lat^ and centers and thefr +el atioris with 
NIE, the financial support recommendationwfar individual orgahi?at1^ons, 
ahd management issues vis-a-vis labs awd centers, with a separate chap- , 
ter.on dissemination and equity issues. <4. ^ . ^ 

♦ 
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The panel, apparently to jts,ow\ surprise, "found a vigorous set ' 

,of ""research and development institutions doing work of quality and 

significance for American education* We had not anticipated this 

conclusion; we approached our task with full knowledge of the consid-* 

erable controversy we had been asked to address^ (p. iv). 

* 

Echoing the Campbell Report, the panel i while finding weaknesses ^ ^ 
.in the work of some^labs and centers, also found "past federal policies 
for their support to be particularly accountable" (p. 1v). However, 
the panel went on to commend the NIE for improved practices, especially 
in the'area of direction and support of labs and centers. The panel 
strongly endorsed the concept 6f institutional support for organiza- 
tions meriting tt,^ along with the phasing-out of work in areas no 
longer deserving special priority (p. vi). 

The Panel Report meticulously details the .history of^NlE funding 
policies for labs and^ centers through 1979 (calling il a "history of 
instability and conflict"). When these organizations were switched ^ 
from USOE to NIE, funding was shifted from an institutional to a proj-^ 
ect basis, then later to a "program purchase" policy. This caused 
severe weakening of organizational capacity, a condition that went un- 
corrected untU^Jl975r^:^/hen NC E ^-^ ^ ln the aftermath of the Campbell ' , 
Report, rgsolved ttiat the 'director of NIE had the authority to es-tab- • 
lish "speciaV institutional relationship^. " Thfs gave a po,licy mandate , 
to support, labs and centers and *was, in the view of 'the panel, a step 

.toward prop^' management of existing institut;ions.* The theme runs * 
t-hroughout the Panel Rsport thaX labs and centers are important means 

^of effecting school impro^efnent , and therefore their management and 
nurturance are of great importance. 

" * The panel dealt specifically with* the need for labs and centers,' 
observing that the knov/ledge accumulated over the past two decades 
reaffirms the need for centers and "strengthens the^ rationale" for labs*. . 

Increased .understanding of the political dimensions of educa- 
tional change reinforces the argument for decentralized decision * 
making. These considerations strengthen' the rationale fof the 
functions of regional educational laboratories that are governed 
,by and .responsive to rSgionFl 'interests 1n col laboration, with' 
. the sponsoring federal agency, (p. 7) '\ ^ 

The panel noted the increasing d4versit^ qf R&D performers, pointing'^ 
to a then-uncompleted study (Frank'el, Sharp,' and Biderman, 1979). 
Furthermore, the panel fert that the particjjlar functions served by 
labs and centers and theyeumulative experience of • each' were not sup- 
plied by other forms of organizations.. • . ' . • 

In- a special chapter of the^report, the panel dealt specifically 
.with the question of dissemination. They expressed an* "awareness of 
the heed for ^systematic, efforts tD ensure that ►the results of [lab and 
center] work be utilized" (p. 43). They were concerned, as well, that 
Tab and center staff keep themselves apprised of 'the wqrk of their 
colleagues, and that they coordinate their dissemination efforts with 



^the many others in existence. Jhe panel noted, "We see tooOittle 
attentioq to forms of dissemination that .are firmly linked to the 
Improvement of practice and too little integration among the efforts 
that exist" (p. 43). 

The report details the 20-year intellectual history of the con- 
cept of dissemination, discovering several stages. Early work focused 
^n the "sowing of seeds" through information dispersal, resulting in. 
systems like ERIC. Uext came two-way exchange notions, which led to* 
''needs sensing" and "feed-forv/ard" mechanisms. Thei> came state 
capacity-building efforts. .This was followed by the recognition that 
many educators were suffering from "information overload," which called 
for development of selection criteria. The panel found the scene in 
1979 to be characterized by an emphasis on human support systems 
providing;-tei^nital assistance and staff development, and on " invisible 
college-building "^ to prcmiote more extensive peer communication (pp. 43- 
45). ' ■ 4 ' 

* • . * * 

The panel saw the developing Research and Development .Exchange 

(RDx) as a potentially strong force for comprehensive dissemination 
efforts. It also noted that because labs and centers are each unique 
organizations, no simple formula, for dissemination activity can be de- 
\^e'lope(j. The^panel recommended that as NIE continued to strengthen it^ 
state capacity-building activity, it^hould also encourage and support 
"[lab^s^^forts to assist each state in the region served to establish 
effective dissemination procedures" (p. 46). It recommended further 
that "fHE should develop a comprehensive p6licy on its role in dissem- 
ination, should conduct programs that are consistent with that policy, 
and> Should implement effective procedures for the dtsseminaticJh of , the 
results of the R&D it supports" (p. 47). Finally, in -an adde^dum^to 
it? report, dated August 9, 1979, the panel added, this recommendation:- 

<r * 

The NCER, in consultation with NIE, should articuUte an 
overall policy for the'>buildi ng of'a.n R&D s^^jtem amd e'n^ 
sure that the Institute's strategies-'for support of re- 
search, deve>opment and dissemination activitfes reflect 
this policy;. The elements of such a -policy should include: 

a. articalation of the links between lab and center missions - 
and the other R&D activities .supported by the Institute. 

b. fostering of col laboratiori and communication, between labs ' 
and centers and^other R&D resources and netv/orks, including 
the full development of\ttie disseminatiom capacity of^the 

^ 50" states. ' ' 

c. ctintinued deveTopmenf of constituent participation in' * ^ 
Refining what is needed from^ research and 'involvement in 

^ts production and*dissemination. 

d. consideration of new trainin^g and human development needS 

facilitate dissemination'. ' g 



e. . Integrating into the routine op^ratiipns of HIE an ongoing 
./ synthesis and assessment of the impact of R&D supported by 
the Institute and others. (Addendum, -p. 2) 

In summary, the Panel Report generally lauds labs gnd centers for 
the competence of the.1r staffs and the quality of thelKwork. The 
.panel found mismahagement from the federal leveV responsible for past 
problems and weaknes^ses, but, also jJIscerned Increasingly thoughtful 

"'direction emergijog from NIE over time* The panel e^cpre'ss^d concern 
about the Inadequacy of 'the dissemination efforts of! some labs and cen- 

* ters and the lac^ of a coherent policy 'regard1r\g diss^mijiation wfthin 
NIE, wKlle pointing out that no uniform policy would te" applicable. 
The panel considered the labs' needs sensing and techni*cal ass^istance 
act1v,it1es to be Important dissemination efforts' and found'the potential 
of, the RDx exciting. ^ \ 
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. Information Diss^emination and Exchange for Educatij^ nal 



• the effort .win be, collaborative throughout, involving 
the entire educational community; 



activities engaged in-will be complementary and sttpportive 



' of other ageficjes; 

• the effort will- be developmental^ Snd c^)ondinated; 

- • it will expl c^re altiernatlve strategies and sol lotions, 

and will deal with a vari^y^of problem areas and clientele; 

. \ . ^^^'^^ - \ : ^ 

• it will/u$e a^ "linkdrage/brokerage" sjtrategy, and will 
depend on NIE' for core support while-'aj^o seeking contribu- 
tory support; ^ • . 

• it will v/ork to ensure equity, (pp. 11-12) 

The entire RDx planning effort was based on the notions^ tJi^t 
(1) a single dissemination policy--acros^ the board for a^l] ingtitu-. 
tions--was undestrable and (2) extensive linkages and, two-way cortnun- 
ication flows between knowledge prodijcers and users were essential.^ 

Chapter 7, "The Bajanced Producer-Client Linkage Excihange," 
begins with the important .jwarning li?iat many knowledge' production and 
iitilization^ (KPU) projects reflect the assumptions of knowledge 



*the_10 Qhapters of these twD volumes offier vary i/ig perspectives 
on how an*>RDx system might best be described. The report chronicles 
the premises and underlying strategies of those who were directly 
involvedj'n the early RDx planning group. Basic assumptions included 
these: ' . . ^ 
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producers, whose conceptual mappings may or may not overlap those of 
actual' knowledge users or clients*^ In fact, it frequently appears 
that KPU activities ,are undertaken because they are seen as desirable 
in and of themselves, rather than because £hey address specific infor- 
mation needs. ' ' * 

KPU efforts are seen yQS needed and arip'* designed b^ information 
producers or ifitermeyaiaries. The reasons are simply that 
-producers and intennediaries are rewarded based on the extent 
to'which 'their products are disseminated, recognized. . .and 
put to use. (p. 3) 

The rfeport sugsgsts that n^eds sensing approaches commonly used to 
determine v/hat\a (fl ient thinks 'often suffer from two problems: They 
assume that the conceptual approaches of clients do not vary; and 
"they almost^lways begin with needs for information and not broader 
needs." The chapter details tv/o polar approaches to needs sensing-- 
the RDD&E ^and problem-solver methods--pointing out the weaknesses ^ 
of e^ch. /inally, the authors recommended that RDx strive for a 
true philosophical consansus among all stakeholders; establishment 
of the strongest possible^links to all other linker/brokers; and 
cultivation and broadqasti^g of an image of client-centered*rest)urce 
linking (pp. 15-16). - ^ < 

The'chapters of -the Radnor work Vtreated above seem most useful 
in antieipatioig of the RD^ work; fthat\now 'follows are accounts of 
actual practice. Taken together, the proceeding three reports detail 
the, actual furictionirtg of the ^Research Snd Development Exchange (RDx) . 
and the Regional Services Program (RSP). While 'these are two separate 
programs, they,,have'sirTf1>ariti'es. Both v/ere designed to bring R&D- 
based knowledge to bear-on efforts to improve schooling. The Regional 
Program Unit report deals solely with the RDx^ the Lallmang report, 
solely with the RSP; and' the Emrick and Peterson report, v/jth both.. 

Regional Program Unit', Dissemination 'and Improvement of Practice Program, 
• NIE. ^The Research and Development Exchange:' In Support of School 
Improvement (1979yi 

The cont;e;{t within which the. RDx ^operated in 197^ is portrayed in 
the opening pages o'f'the Regiojial Program Unit report. - By the late ' 
1^70s, federal policy and'funding had "shifted from support for produc^v 
tion of new starts to more effective delivery and us6 of existing out- 
comes." The previous tWo decades had made it clear that "R&D products 
and programs, v/hen implemented with fidelity, do make a d.ifference. " 
The contextual segment concludes that "increased practitioner, involve- 
ment is needed to. ens^ure the responsi x.eness of future R&D sponsors and 
producers with respect to the production, synthesis and delivery of new 
knowledge" (pp. 1-2). 



The goals ofyJ^Dx ijiclude: CQordination of di ss^mination/school 
improvement programs;' promotion of use of R&D outcomes; provision of 
information, assistance, and training; and influence over future R8D 
outcomes thraugh »thg identification of client nfeeds. The RDx effort 
is a user-driven, 'devje^lopmenfal , coordinated, responsive network. BDx 
clients ar% primarily intermediary agencies (although the ultimate cli- 
ents are, of course, students^ teachers, and building administrators). 
The "pivotal" client group is composed of the state educational agencies 
(SEAs) and their*<lissemination* and ^school improvement staffs (pp. 3-4^). 
At the time of t^is report, RDx membership consisted of seven regional 
exchanges, four central support service agencies, an executive commit- 
tee, and an advisory'group. .The seven regional exchanges were all 
housed in regional edDcational laboratories, as were three of the four 
support services,, with the fourth being located at a university center. 

R. A.'^allmang. ^ A Description Of the Regional Services Program {1980). 



According to the Lallmang report, the main defining characteris- 
tic of the RSP is that services provided entail "the application of 
existing R&D processes and outcomes to the solution bf short-term 
problems identified by the qlients in the region served" (p. 1). The 
RSP, at the'time of this report, was located in five laboratories 
where service was provided primarily, though not exclusively, to SEAs. 
Because service>-4vere field-responsive and because service delivery 
techniques varied, a uniform, de.tailed description of the RSP woold 
be impossibT5§"/ The services differed by laboratory, but in some way 
all were related to issues of "educational policy, planning, evalua- 
tion^and curriculum" (p. 1). The report states that variations in 
service delivery were supported by NIE so that the Institute could 
.study this variation. « 

RSP projects have these as defining characteristics: The service- 
provider is primarily accountable to the client , ^rather than to. NIE; 
service ten^ds to be intensive and of short duration; the target audi- 
ence is ^composed primarily of SEAs; and thi-s audience is defined as 
a function of the problem selected for attention by the individual RSP 
site. 

Some RSP projects, seek matching funds and some do not. At the ^ 
Northv/est Regional Educational Laboratory (NWREL), far example, NIE 
funds serve as "seed money" "to generate performance contracts: From ^ 
December 1, 1978 to June 1, 1980, NWREL signed 101 contracts for a" 
total amount of $926,285, whilfe NIE's contribution to the program was 
$243,637. (The Lallmang report details the activities of all partici- 
pating RSP projects, but the only financial information reported is 
from NWREL.) . , ^ 
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J. A. Emrick" and S. M. Peterson. The'NIE Regional Progcajns: Evolutibq 
of the R&D Exchange .^n,d Regional Service Components (1980 K 



The Emrick^and Peterson* report is the most discursive of the 
three. It discusses both programs;, it includes a historical overview 
and analysis, as v/ell as reportage of the efforts ynderway. 

In t>he review of federal efforts related to educational dissemi- 
nation, the emergence of three important-concepts is presented: thre ^ 
need^.for human extension agents with teaching tackgrbunds to dissem- • 
inate kjiowl edge;' the need to incorporate a practitioner orientatfon 
in knowledge products; and the need to view the educational R&D enter-t. 
prise not as a. ^'system" but, in Clark and Uuba' s. (1974) t^rm, as a^ - . ^ 
"configuration" (Emrick and Peterson^ pp.'*>6-7).^ Early thinking aJKiut; 
regional progratns on' the .p^ of 'the Dissemination and ResourcesTroTip 
%at fi^ took these needs inj^accouht and used them,' in effect, as 
spe^irf icaticms f^or^work in the field.,"^ 

J JA] RDx projects'^re lacated'^at. labs and centers^^ in "an attempt /; 

'*to build direct linkages between ^3 subset of R&D producers ^nd other'V 
groaps in the educational community" (p. 10). These organisations were 
assumed to/have direct access- "tp a variety of products and expertise"' - 
(p. 11). Structurally, RDx is a combination of centralized and decen- 
trali2;ed functions, with resource access in the latter category 'and ^ 
system support in the. former. Emrick and Petersbn point out that • * " 
housingASupport functions in four separate organizations increases 

."the- importance (and the difficulty) of coordination*, .[but aT^so] the. 
opportunity of .obtaining the best available know-how in specia'li?ed 
areas of dissemination";Cp. IT). , 

Emrick and Peterson's specific review of the mechanics of 'RDx and • 
RSP ^choes the two reports, discussed above and needs no repetition. 
However, their discussion of the interfafce between RDx and RSP deserves 
note. This interface is not yet well ^documented or compreheaded; but 
^ overall',^ the authors suggest that RSP staff can be loosely understood, 
as "appTication specialists," while RDx staff serve more as brokers, 
linkers, 'and disseminators of knowledge. The' report suggests questions 
for further research;, but concludes that by April 1980 the components 
were -fn plac^e for a concerted .effort ^n knowledge exchange., and the 
tr^ansrfiission of^specifi^c technical assistance. \ "The \ikel ihood of ma^or 
and demonstrable educationaul improvemehts attributable. to this program ^ 
cg^nf iguration is v^ry bl^h" (p. Z^). , / 
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J. Fra^kel, L. M. Sharp, and A. D. Biderman. Performers of^Research and 
Rese5rch-Relat&d Activities in the Field^of Educatiog. ( 19/9 J; 



L.. M.. Sharp and vL Frankel. "Organizations that Perform Educational 
^'*R&D: A First Look at the Universe" (1979)* 

« This report and the subsequent article relate the process *of com- 
piling the American Registry of Research and Research-Related Organi- 
zatior>s in Education (ARROE) an^d describe its actual content;s. Care 
went into the selection of organizations for inclusion, each having 
to meet particular .criteria. 

• .For the purposes of this analysis, only a few key points from the 
ARROE are relevant. First,* a quote from the summary section of the re- 
port puts itsf majc^r findings- succinctly. The universe of -organizations 
in this field* is: 

-large--2,434 active orga/iizations were idehtified; 

-dominated--in terms of members--by small organizations, 
i.e., those with education RDDSE expenditures below $150,000 
and fewer than two Aill-time professionals with -primary re- 
sponsibimy for education RDD&E; 

-dominated--in terms of expenditures—by the 172 largest 
performers, which although they constitute only seven per- 
t^TTtof^the universe, account for nearly 70 percent of all 
V " expenditures; • - ^ ^ ' - 

-di vehse-^-with the primary mission of a majority of organi- 
^ -zations lying outside the research field; 

-dis|j)ersed throughout the natioVi--but with large concentrations 
in New^ork, California, Ohio, Illfnois, Texas, Pennsylvania 
arid Washington, D.C.^;" and 

-young--with 40 percertt of the organizations created during^ 
the last 10 years. (Frankel, Sharp, and Biderman, p. 94) 

# • 

The authors found that few organizations possess capacity -for ef- 
fecting school improvefnent: Few organizations special ize in .educa- 
tional R&D. Few have a critic6l mass of e)$:pertis?. Few have any 
prolonged experience or history of interactian with other educational 
actors. 

In terms of activities conducted by research-re-lated organizations, 
the authors found that 

" ' practically all organizations spend at least^some of their 
funds for research, but research is emphasize. most hea^'ily 
in the-academic and private sectors, whi^le development and 
evaluation "studies dominated in public education agencies.. ^ 
Dissemination emerged as the area of lowest emphasis, re- 
ceiving the smallest aljocation of funds by performers* 
except for state agencies and large public school ^systems. 
(Sliarp and Frankel, p. 9) 



These papers suggest that more» research activity shoul<l occur in the^ ^ 
ptityrTc education arena, since these agencies can be. more quickly 
and cogently responsive to practitioner need. ^ ' . , 

' In sum, the experience of compiling the ARROE pointed to few 
capable .organizations; identified a need for more emphasis^on dissemi- 
nation; and revealed a need for 'greater involvement of staff from 
public educational agencies. ^ . ' . 




The works discussed 'in the first section of this paper included^^ 
tv/o major reviews^ focusing on labs and centers {the Campbell and Panel 
Reports); conceptual papers, two reportorial accounts/ and/one analytical 
report on RDx and RSP; and a -major, pi ece of research oil tire universe of 
R&D performers in education. Ojily one of the works is ac^al research. 
Only two'-^he first two--are truly comparables in the sense" that they 
both look at i^bs and centers artd, their relation to theXNIE. 

Our central question ("How do labs ^nd centers ^operate with regard 
to dissemination and school improvement?") -is not tla^^ajor focus o-f 
any one of ^these individual documents. Yet the works in toto , and in ^ 
conjunction with knowledge possessed by this author, can give us clues. 
It becomes 'our task to infer an answer. That, answer might best be 
approached b> analyzing these works in the .Tight of certain key proposi- 
tions tlvat distill the experience of the organiza^'ons ovier time and ^ 
assess l^heir capacity for school improvement. 

Proposition 1; Healthy organizations show signs 'trF\ organizational 
learning, ^geve-lopment , and refinement of understanding regarding 
their major tasks. Such- learning' has occurr*ed in both the labs -and 
tenters and the -sponrsorinfl agency, NTE^ ] ~ 

Th^first university centers were established in 1964. The ini- 
tial laboratories were set up'in 1966. When the centers were^ estab-^ 
lished,, it was thought that such organisations would "do everything" 
"--reseSi^ch, -development, evaluation, dissemination, implementation 
(Salm'qn-Cox, 1978; Mason and Boyan, 1968). The creation of the re- 
gional edycation9il laboratories (RELs) actually clarified the mission 
of the university-based centers, while beginning a long-standing con- 
fusion over -the appropriate qjission of the RELs themselves {Salmon*-Cox, 
1980a, sl980b). For^-with the appearance of the fJELs, centers began to 
concentrate heavily ,» though not exclusively ,'^on research and deVelop- 
fivent.- RELs, on the. other hand, suffered from unclear definition of 
puT'ROse, as was notecl in several of the reports.. 

However'^ it becorues clear, especially v/hen we cdmpare the, judg- 
ments of, the Campbell Report to those of the Panel Report, that RELs 
have" begun "to coalesce around certain key fAjnctions." This, is true 
across th»- entire set of , labs, despite markecJ ^differences in.thgir. 
structures and scopes* of activity. , Among the ljjey functions for which*" 
each RfL, appears to have capability are: dissemination activity, 
technical ^ssista^nce, and resource brokering and exchange. Addition- 
ally, each REL' rs in touch with and responsive to the needs of its 
region." White there remain regions of the country ynserve'd by an REL, 
where thesB Tab's tio exist service/ is indeed being rendered%and/some 
educational needs Are being met specifically by these organizations. 



*^ Centers have comp to be problem-oriented, conduct ing^^r^arch and 
development consonant with NIE's priorities. Those priprifi^esvresult , 
frqm congressionalTiandatei^^as ^rrel 1 ^s from NCR direction and NIE lead-.^ 
efship*. .Hence, centers are currently working on^.those' problems deemed 
most important nationally* . < • . . ^ 

» • ^ 

NIE has demonstrated that it haV Teamed fnom cr*iticism. Thi^. iS 
particularly true. in two area.S t+iat are 'important for our consideratiOa 
here: the direction and management of l^bs and centers, and the^struc- ^ 
turing and implementatfoa of di sseriii nation acttvity. Regarding the 

• first area, the 'Campbel 1 Report made- it clear that the then-curr^t 
"program^pu^chase" policy of NIE ha^ti had deleterious effects o#n^bs y 
and^ centers and, furthermore, that the monitoring arid management of ^ 

.tffl&se organizations had bee/i uneven and confusing. By the time of the 
^anel ReDort\ JjlE^had returned to institutional support and to long-r 
term agreemerff^with the labs and center's. " Regarding the second area, 
the need for NIE to systematically plan and imRlement dissemination 
activity is a theme ttrat runs throughout tt>e repbrts reviewed (and one 
emphasized heavily in the. thinking about in}plementdtion-,of the ROx). 
It is ndw apparent, that' NiE^ has taken this advice serfously, having 
funded planned' variation Btudies--^s was recommended--within the 
context of RDx and other dissemination activity., ■ 

To- summarize, then: It^hile the Campbell Report found fault both 
with labs and centers and/v/ith NIE^^the Panel .Report endorsed long- 
term funding* for seven off the. eight RELs and,seyen -of ^ the nine eent^s*, 
finding them healthy and Voductive orga'nizations. And NIE, by its 
own record of activity bysr tht past several years, has demonstrated 
a capacity. for learning^ 

. . ■ ^ ■ r ' ^ 1 ^ ' ^ ' \ 

P^osition 2: Institutional .capacity is*essent\a3 for comple-x problem- 
solving . ~ \ ^ - ^ ~7 ^ . ' ^ ' * 

Both the Campbell* anaM:he Panel Reports reaffirm' t)ie need for 
iastittitional ized^capacity ]fort.educatiohal kYiowl edge production. Edu- 
cational researcti'can and does receive significant contributions from 
the individual researcher or small group; but ^undertakings such ^ 

* development' activity, lafge-scale'evalufttjon, programmatic interdisci- 
plinary research, and resource sharing, a-llocati.on, and' hrokeri n.g are 
better suited to organizations than to individuals. The, deliberate 
decision to house'the RDx -and RSP programs in j^ELs wa^ based on the - 
.recognition that organizations 'were essentia:! for these pxrograms* 
'tasks. In fact, the^organi:zations i,n'guestion already had structures' 

(governing boards,, nptworki ng^f aai 1 i pies) .and staff capab^il ities 
suited' to those^tasis. * ^ . ^' . ' ^ ^ ' / ' 

Center;s !aUo over t/me have ^ngag^d in work^' requiring an insti-, 
tutional base* ' The" emj>fias.is of activity withirv *qenters .has shifted 
from program and product difevelpprrtent to pr'barammatrc' basic and applied 
research. In' both, cases, the^ability of a Ojni vers i,ty 'center |o attract 
a critical mass of scholars^ from multiple departments arid disciplines, 
has been crucial to the kind and quality of *kndwledge\prGduction 
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undertaken. Thr'oughout the Panel Report (intluding the individual 
site yfsit reports), centers are given high* marks for their work. . 

Another-th^me prominent during the past five- years has been the 
na^ed to incorporate' the perspectives of women^and minorities into educa- 
-itional research,. NIE developed a/program to accomplish this, and mm' 
labs and centers sponsored related training programs. In fact, -the 
first round of 'fo^^ded proposals ^in this area went exclusively to lab^ 
and centers as tne-jnost approjSn'ate places to begin such \iork. - ^ 

For the tasks undertaken both labs and centers, an institutional 
capacity is Essential. Both kinds of organizations have jcore^staffs ^ — ^ 
of sufficient size and training, organizational support' services, and ^ 
the ability to plan an.d Cd^rry put long-r^nge programs of work, 
s 

Proposition 3: Mission orientation is essential fdr efficient and ^ 

• high-quality goal realization . ' . * ; * . 

It is clear from the historical record that both labs and centers 
have grown .in -tbfeoT* edacity to focus in on certain functions aad prob- 
lems. In the sixties, "notions about organizational responsibil ity were - 
diffuse; during the seventies ,• ideas ^aboijt what each kind of organization 
might hope to accomplish grew-more sophisticated. Agaif^,^ as noted in 
the rpports there is wide diversity of activity among the^ labs and 
centers. But "overal 1 , centers tend to focus on programmatic R&D, while 
Jabs possess strong capacities especially fo^, technical assistance, 
knowledge brokering, and networking. In the past several years, under 
direction from NIE, ma»ny labs have,.come, to work closely with SEAs ^nd 
LEAs. The rel ationships 'so^ QStabl i shed .are crucial W scho'ol in^Drove- 

• ^ent efforts./ ^ ' ' ' ' 

V 

Proposition 4: In the ^rea of dissemination activity, important, 
fadilitatinq mechanisms are nyi-/ understood aad are being put to use . 

Dissemination is clearly an area of co.ncern for man^. Both the 

• Campbell and Pane] Reports pay special attention to it; the RDx and 
RSP programs were created in direct response to perceived needs in 
this area. As the entire domain of educational knowledge production 
took clearer sh¥pe Over the past 20 years, numerous types of dissemi- 
nation activities were tried and variously found wanting. In large 

■ measure, early efforts probably suffered from over-rel iance on models 
for dissemination borrowed from other fields (agriculture, space 
technology, etc*)- Slowly, the constraijits and opportunities particu- 
lar to the American educational scene became clearer- NIE and organi- 
zations in the field have learned from experience and advice. As a 
result, current dissemination efforts emphasize: 



\ 



the need for regional netv/orking involving mL(ltiple 
stakeholders and utilizing human corrniunication (as 
opposed to simply disseminating printed information); 
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* • the need for, national coordrnation-^f -^^esources so- that 

problems of one region may hh met by proven ^solutions ^ 
developed' elsewhere; * ' ^ . ' 

• ' • . V \. ' ' 

% the need for planned variation in dissemination strate- ' 
,gies, recognizing the'decentrel tzed, locally based 
nature of American education; ' ' . ; 

. • the .n&ed for cofttj nuous,* long-term cormiunication, as 
opposed lo "/Single- shot" consultant visits; 

-vt finally, the need to talce the p,o^i4ion, in many areas, 
- ,that knowledge applicable to immediate^ problems does 
gxistj/ "More research *ts neenjed" may bfe a'truism in 
many important sifbstaptive areas, but a great deal has \ . 
already been learned that can be applied now. 

' Proposition 5: Practitioner involvement, j^jdicibusly strugturedys 
a. key element in dissemination . * ' * '-^ ^ 

This point is important e^nough to be singled^ out; organizations 
. in the field, and/t^e NIE as ,well, have come to understand ttiat the 
client must Be involved in majiy aspects of knowl-edge /production. In 
the ^area«^ dissemination, th'is iavolvefnent is crucial.. And the 
strJctOre of that frtyolvement must carefully thought through. It 
?s unreasonably to expect teachers to. accept ^ready-made "sc^lutions" 
-to problem^ they'may or may not- think they"^have; neither i^s j"t re^ason- 
able to expect researchers ..to allow thejr 'strategies to be defined 
totally by practitioners.' The several r^pof^ts reviewed display 
ificreasing^ sbphistitfBtion in the field regarding appropriate levels 
for intervention (e-g-> S£A, LEA, buildi'ng level) dependjng on the 

• problerri to be^sal ved, and styles ^of interaction ^ again depending upon 
problem^and level.* ' ' \ ^ " 

' ' c" ■ ■ • ■ . 

^ Proposition 6r Labs and centers participate in school improvement • 
activities to -varying degrees . ^ ^ ^ 

R^Ls engage fuHy in school .improvement act ivi ty--that is, in 
'research-, development, arid dissemination. Centers, hov/ever, focus 
'••primarily only on" r'esearch. However, all of the centers engaged in 
rs(5m^,form of product cjevelopment in their earliest days; many continue 
to'be involved directly in education through these prpducts. /inaMy, 
several centersshave evaluation research components; one center is de- 

* >/6terf entirely to vork in^thi's area. In sucfr research, direifct involve 
' ment wit;h ^school settings is' inevitable. Of course, this involvement. 

* does not necess^irlly Vesylt • in immediate direct improvement efforts, 
but it 'can.^ Al^l of the -above 'activities can be .Viewed as school im- 
pr4pvement effofits. ' ^ ^ 



^Proposition'?: RELs aRd .university centos special ize -^x cTjsively 
in knowledge productloo functions for edoe'atiori. There are at 
present ]no functional 'a1teri:^ative5 >to. these organizations . 



■\ . All the reports reviewed recogrTized ^e iiiportance of the role 
played by Hbs.and centers. Jhe^Campbell Report, the on'e most criti- 
cal- of labs and centers, yet spoke -of the need for such organizations 
» and' endorsed the' idea of national laboratories. The Panel 'Report ; 
sev-eral j'eacs later found strength 'in most labs and centers and again 
heavily ertdorsed the concept, while ^ointing-to areas in need of im-- ' 
provemeruC. The RDx and RSP programs rest on a fou)ndation of institu- 
tional support' provided by iab^ and'cehters. FtTTcfl^ly, the Frapkel 
heseareh makes eminently clear how few organizations there are with , 
adequate resources whose missions-are totally committed to the domain 

of education. . •, \ , 

*. • ' '. 

Important roJes- in educational dissemination and school improve- 
ment are played by SEAs, LEAs, profit-making research organizations, 
schools and colleges of education, and individual researchers. Yet 
none of these has ihe capabi 1 ities offered by labs and ceMers, .either 
individually or in some formof consortium. 




Section 3. Recommendations 



The recommendations that follow grow directly from the'^first two 
sections, of .this paper* The rationales for each are"" contained in the 
preceding analysis* . ' ^ • 

1. Improvement in American education is contingent upon building and 
maintaining our scientific understanding^of educational processes * 

* • 

Educatioji> is^a profession, like medicine or law. A profession 
^need's knbwledge bases out of which rational actions can be derived 
and .improved practices developed. Neither by hunch nor by intuition . 
can school improvement be efficiently conducted* Particularly in a - 
time of declining resources, an ethic of " efficiency combined ^with a 
desire for efficacy argues for sound Investment* Developing the , 
science of education' is one such sound investment* Of courafe", th'js » 
development is not limited to the activity of institutions, but it - 
is well supported by their work* # 

In the sixties, when educational research first emerged as a field, 
it seemed possible to fund^any and all school improvement ideas* Now 
in the eighties, as our possibilities diminish,^ it is imperative to • 
Vund thop ideas jnost likely to make a difference. 

2* Greater coordination pf existing resource^ is^desirable * 

In order to maximize the potential of ^hat is now known- and avail- 
able, NIE should exercise leadership in coordinatlng^existing resources'* 
Leadership and coordination do not Imply uniform policy, as NIE seems to^ 
have apprehended already. The Institute, for example, should continue J 
to encourage planned variation studies in the area of dissemination, ^ 
as the best wisdom on the subject currently suggests* 

Yet It is apparent' that there has been insufficient funding for 
coordination t^.g*, for RDx personnel to meet, share experiences, ?nd^ ^ 
n^arn 'from one another). Within the CEDaR, organizations there is a ^ 
nascent .project on school improvement, attempting to bring together 
participating "organizations' exf)eriences. Recently, educational' * - 
researchers within AEi^A have disjssed the possibility of !mounting\ , ^ 
school Improvement efforts to d^^strate the efficacy of educational 
research. There undoubtedly ca^^|ll be top many such efforts; but 
clearly the^ loCus af readership should be a^ NIEj not in any one 
professipnal or other group. ' . ^ 

Within the Institute, in* the minds of project monitors, program 
personnel, and intramural research^personnel , resides a large body 
of knowledge. ' That knowledge includes awareness of lab and center '* . 
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programs. a*s well as of a -host of o~"ther programs and needs natiotrWide; 
■it should be more systematically organized .and put to use. \ s. , 

/ 

3, 'University centers should be encouraged, to be flexible 
in. their scope of activity * ^ a ' " 

RtLs are more, specifically structured to meet technical -assist- ^ 
ance' needs for school- improvement than are the centers. Labora1;ory 
capacities inthis area have been enhanced by the development of the 
RDx and RSP programs. Havl^ig* suffer^ .for years from unclear insti- 
tutional definition, the -RELs hW now coalesced around these func- 
tions and are providing important^service. 

The situation for university centers ^'s- less clear. While uniyer- 
sity'center^ as'a group have a variety of missions, the resulting dif- ^; 
fusion of emphasis in centers' acti vities\+f an advan.tage for the field 
as a whole. The interplay between research and development cycles 
takes a certain inevitable course, ^causing centers' work to be more ^ 
or less immediately tie'd to school need at any given point. Yet air / 
centers' work is targeted to the creation of a knowledge base -for 
educational practice. This flexibility mu*st be encouraged, as must 
the diversity" of mi asionsii^encompassed. ^ \ ^ 

4. Institutional support for labs and centers must be maintained . 

Institutions offer the capability for sustained, effective wor^ 
on -educational problem solvi.ng. The most important and complex p,rob- 
lems in education do not lend, themselves -to -quick or simple solution. 
To goon building the knowledge base on which school improvement will 
continue to depend, or 1;o expand the effort to- appl-y what is now known, 
and ready for application, it is essential that educational research 
organizations, £ua organizations, be maintained. Ttiis requ1>i:es sus- ■ 
t-ained policy vis-a-vis these organi^aitons, long-terrt funding, high- 
quality review on a regular basis, dnd the planned phasing-out of 
areas of work /no longer productive or relevant.. 

The authoVxis mindful of the current political climate. F-und- 
ingVor NIE" has been severely reduced; and the Instittrte s contractual 
obligations are largei It^woutd be easy- to say^that cur.rent . federal' 
expenditures for educafiqnal research ar6 totally .inadequate, do not 
reflect the productivity of the field as a whole, must be increased. 
Yet that k^ind 9f recommendation is beyond the scope of thi^s analysis. 

« ' '■ 

There is currently a -cry for "open competition.,"' (What^this trans- 
•lates into for institutions and individuals must be carefully planned-. • 
Any return to "program purchase" policies for progr^mmatid R&D insti- 
tutions such a-s ,^labs and'ce^nters would vitiate the institutional capa- 
cjties so '.carefully nurtured through past uncertai'n times". > . \ 
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Preface 



As preparation for this paper, I- read the works listed -in the • .• 
bibliography. Some deal^directly with the SEA role in dissemination, 
some j:angentially/^ • - 

, It became evident that the papers bare!/ scratch the surface of ^ 
di field that has exploded into a vast landscape in the pa;st "20 years. ■ - 
• They cover so small apportion of the subject they address, and much 

of that so 'superf.icially, that they ra'ise more questions than they f ^ 
resolve. It -is only fa\r, to note that the fault lies not so much 
with the papers themsel v&s 'as with'the unwteldiness of the territory 
.af^ dissemination. In any case,. the customary survey method--reviewing 
'the research and offering a few suggestions for further work— would ^ 
"be inappropriate for these papers. 

Instead, I have taken ideas- from them--along with others that 
occurred t9'me while reading these p-apers--and have formed them into 
this essayl Sometimes the papers are cited and sometimes not; thus, 
they have-played> larger role In this paper than specific (jitations^ 
' would indicate. ^- ' ' v 

The paper approaches fts topic by examining the role of SEAs as 
units of state government and qonsidering the likelihood that they will , 
engage 'in dissemipation'as a st^te itunction in the^ absence^f federal 
intervention. Then the paper examines dissemination as"a 'field of 
st)wdy--the concepts currently employed in the field as well as the . 
methods usually used to study SEAs as dissemination agents.- The paper 
co'ncludes with some thoughts about the implications of the first two 
• sections, for NIE^'s future research on the ro-le of SEAs in dissemination. 

• . ♦ ■ 
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Brief Review of Reports ^ 



M. Brickell. * Survey of Stat'e Education Department Research, Develop - . 
♦ ftent ,/Mjem6n stration, Dissemination and Evaluation (RDDDE), 1969-70 ' 

Scope -^of the Study " -* . " • 

* This study was conducted in the late 1960s to document the status of 
state education agency research, development, demonstration, dissemination, 
and evaluation (RDDD&E) acTtiv^i ties. Survey methodology was used to collect 
'data for the study, involving site visitor to 12 states, questionnaires 
mailed to all SEAs, and meetings at nine regional U^OE, offices-* Reseanga 
questions probed the organization, financing, staffing, and activities^ : 

of sta-te education agencies. * • ' 

m 

Findings - / " 

A nuniber of research categories were studied. Findings are reported 
here by theme or topic: 

• No RDDDM activities were reported in 25 percent; of the states. 
The SEAs that did docuin^nt such activity indicated that jt was 
located mainly at administrative levels. , 

t State funding for research and/or evaluatipn activities was provided 
to 80 percent ©f the SEAs, and 32 percent received state funds for 
development. SE^s wer^e more likely to ^eceive federal than^state 
funds for each of the five RDDD&E functions.. 

,f Outside dffil iatipng with other SEAs were -reported by a majority of 
the states.^ A minority of SEA-s had started intra-state educational 
research councils,' and less than one th^d ^had^become linked to 
another R&D organization within the state\ 

i. The .climate for RDDD&E within tlie SEAs was liot especially robust 
and was seldom supported. These unsat isfa(ttory conditions werd 
"^^^ perpetuated by the fact that avalu^tion and , assessment were con- ^" 
sidered more important than research by^the governors and I'egisla- ^ 
tulles involved. ^ - » ' 

*These summaries v/ere prepared by Sue McKibbin, Educational Dissemination 
Studies Program,- Far West LaJ^oratory for Educational Research and Develop^ 
ment.' * . * > • ' . ^ 

■ - ,• . --8 




^ • • Technical assistance was frequently provided by one 
^\ another. Occasional , unsystema'tic assistance was o 

^LEAs, intermediate service agencies, professional a 

•and statife government agencies* 

Personnel in half of the states lier'e supported by fedei*a1 

ESEA Title V funds. Joint appointments of 5EA staff at 

coll^ges arjd universities were common. , ' . ' • 

' • Project designs did not move the» work through a series of 
stages resulting i a the development of -neW prcf^rams. RDDD&E 
•activities were not directed to state or federal policy 
que^tions^ and there was no ready aggregation pf results* 
V * ' 

Pol icy ^'Implications . , ' . ■ 

The study concludes* that no^S|A entered the 1970s with satisfactory, 
staffing, funding, or organization for RDM&E. There had been no memorf- 
t)le SEA initiative in educational -researcti and development. Although 
federal initiatives and fundina had contributed greatly to strengthening 
the role of RDDD&E, SEAs were not yet providing much of the knowledge base 
in education. 

The report suggests that state support for RDDD&E activities -was lack- 
ing becdjjse the governors and legislatures ^did not expect SEAs to engage 
^4>n>eflective study. Furthermore,' educational researchers traditionally- 
icould not use scientific inquiry to inform policy questions. Nothing less 
than a new concept of research and develoRment in, SEAs would turn the tide. 
The report note^ that because SEAs constrain research functions, RDDD&E 
programs should be designed to go. w'ith the grain of the institution. 
Aligned with the mission of. the SEA, educational R&D at the state level 
could serve and .survive* 

Twelve propositions conclude the study. They are-provided here: 

Th^ target Sf SEA research is not theory but improved^ ^ 
practice. ^ . / 

2. The consequence of SEA research is not understanding , but 
action. 

3. ' The most suitable outcome is not a finding but a new law; 
- regulation, or advisory bulletin. 

4. The correct mood is not reflection but a desire to reach 
the deadline before the pending decisions rea'ch it. 

5. Natural clients are not members of the profession at 
large, but other SEA' administrative units. 

6. The correct location is not the laboratory but either the 
^ library or operating schools* 
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7»r The natural companion of ^n $EA researcher is an SEA 
planner. ^ . , . ^ , 

8. - The best .research designs are hot experimental but evalua-^ 

• ti ve. : - - . - ' ' 

9. Proper e^idenpe^^s subjective as often as it 'is^ oj^jective. 

10. An_appropriate criterion forjudgi.ng the success 6f a pro- 
gram^is not effectiveness b,ut benefit in relation to costs. 

11. * The proper audience for a research report is composed of 
-.those who raake decisions about -the operation of the schools. 

12. The appropriate reporting media are not pY^ofessional jour- 
\ 'nals but public press, radio, ^nd television. tpP* *8-56) 



D. Madey et al. Building Capacity- for Improvement of 'Educational Practice: 
An Evaluation of tllE's State I?fS$emi nation Grants Program (1980). 

Scope of the Study 

In this research undertaking, state education agencies were studied in 
an effort to describe their, fftipljBfnentat ion ^of the State Capacity Building 
Program. This program was sponsored by the Natio-nal Institute of Education 
to facilitate the development of a national capacity to disseminate R&D 
knowledge in order to assist educational improvement . efforts'. ^ NIE's intent 
was to help SEAs implement^ strengthen, and institutionalize such programs.. 
Interactions between NIE and SEAs, SEA,s and LEAs were detailed, providing 
insights into the process of top-down change. Two questions guided the 
, research: , > 

\ • Is dissemiaatlon capacity being built as a result of this pro- 
gram, and if so, how? * ^ 

• Is the program having an effect, and if so, what is it? 

. Site visits^^vere made to 29 state education agencies, where three re- 
s(^ondent gr^oups v^re interviewed: State Capacity Building Program direc- 
tors, SEA administrators^, and information resource ITase administrators. 
In. addition, NIE staff were' interviewed. Data were organized according to 
these categories: SEA characteristics, NIE program characteristics. State 
Capacity Building Program characteristics, and facets of an SEA dissemina- 
tion system. ^ 



Findings 



A summary of the overall findings provides some geheral statements 



about the development of the State Capacity BuildLng Program, given tfie 
diversity of the 29 SEAs studied. li: was found that within each SEA, 
existing structures wer^ used for the' imp.l-ementation of the project. 
The type of resources us'ed by SEAs varied widely, but almost all projects 
had .reasonably comprehensive coJlectrons of information resources. Client 
requirements and demands,.were "major determinants of comprehensiveness, 
types of services, and linkages me'chanisms used. Most projects emphasized 
personnel linkers, who can respond..mcist effectively to "individual client 
needs. • . 

Research findings were organized ground various categories* summarized 
below: . 

A- 

1. On th^ influence- af SEA characteristics on %tate Capacity Buil.d- 
ing Program characteristics: 

' " 1^ * ^ 

State size i^ related to project emphases. 

""^t Existing st^Octure's are used to provide linkage services. 

t Bureaucrat!^ rigidity prohibits change. 

; ' t Content-spfe^ffic emph'Sses. witt^in the SEA discourage coor- 

^ .di nation. ^ - 

2. On NIE management^ 

' • t NIE's npnpresc'riptlve , approach has permitted diversity. 

t The extentV the SEA -project director's interaction with 
NIE is positively related to program development. 

^ 3. On tbe influence of -.contextual variables: ' 

* t The^ level * of resources and activities increases, with the . 
length of ;^h^, program's existence. 

t The SEA prefect director's tenure is strongly associated 
. with the comprehensiveness of the program. 

* ' t The placement of the State Capacity Building Program in a 

service^oriented unit, in the SEA increases activity and 
impact. 

• Targeting services to special groups enhances comprehen- 
siveness.' . ' . 
f ... 
4. On the types of'Jijikages between SEAs and LEAs: 

't SEA staff 'can seryg as. process helpers, solution givers, 
or resource finders."? 
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'^5* 'On the..app^aches states may follow tp afchieve dissemination 
^ :.!capacify:-' - , ^ * - ^ 

• "^he three main. ap[3roac^^s focus on specific Clientele, 
' ".^ ' specific topics, or general ized. capacity building. 



Policy Implications -s.'^ ' - 



. ' Six CQrrclusions may be of interest to ppl "icy makers who are con-i 

^sidering similar federally or state-supported dissemination capacity- 
building* efforts: ' . \ 

1'. There vyere di>screpancies between intention and implementation. 
. Individual SEA project histories wer.e somewh.at inconsistent 
' * * ^.wHh federal program policies. ' ^ 

2. The State Capacity Building Program stimulated the djsvelopment 
and institutionalization of SEA dissemination programs. * 

3. 'Capacity building had identifiable patterns of development. . * 

4. Sea dissemination resources and linkages were fragmeritec) because 
of lack of cooperation among federally funded programs. 

5. Project placement and .leadership within the SEA greatly influ- 
enced effectiveness. 

6. Limitations on the role of NIE's project rnonitors restv^icted 
- their effectiveness. 5- 



P. Martin. General and State-Specific ResuUs of^he Dissemination Survey 
(1981). , ^ ^ 



" ^cope of \he Study 



ERJC 



The Councj^l of Chief State School Officers- sponsored an inforonal survey, 
to determine the current level of dissemination and school improvement ac- 
tivity in all SEAs. Forty-nine states responded to the survey, offering 
a current and comprehensive overview of funding, general disseminatfon serv- 
ices, and interactions with^other agencies. 



Findings " 

^ Highlights of the survey results are summarized here: 
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t t)i$sein1nation services offered by the SEAs were: spreaid^ ('i n 31 .5 
percent of the SEAs), exchange (27 percent), choice (2^*1 .percent) , ^ 
and implementation (19.4 p«4;cent). Th^ primarj^ servicg'-wps the 
^provisiorT of information and assistance in its uSe. . S^^condari ly-, 
'5EAs helped coordinate and implement educational' programs.^^^ SEA 
staff -provided direct services or worked through fieM-based linkers 

't Dissemination had not yet become an institutionalized furlction ofe 
SEAs, a^fthough the NIE-sponsbred State Capacity Building Program - 
had cantribuVed significantly to the development of dissemina- 
tion activities'. v , * - , • 

t Legislation mandating- school ijuprovement existed in Upstates. 

t Policies and procedures were iiifluenced by federal prograjn 
*' requirements, state fundi^ng, and SEA -staff commitment*. 

» Coordination of dissemi nation act ivities with other agencies 
was evidenced. Twenty-two SEAs interacted closely with labs 
and centers, 17 with the^state library ^ and 15 with intermen'^ • 
diate units jntheir states.' Sometimes, in fact, there seemed 
to be more coordination with external agencies than there was ^ 




*interaally. • 



^ 



Funding was provided by bbth federal and state sources. Thirty- 
seven SEAs received, some sort ofe state fun4j>ng; federally sup*- 
porlied programs such'as Title In-C, special education. Title I, 
and>ipN contributed.- to overall di s^semi nation efforts. Twenty- two 
state's experienced decreases in dissemination funding, and eight 
/ Obtained increases. 

t The greatest J nflu^'nce on- SEA di ssemination activities was the ^ 
State Capacity Building Program. The Regional Exchange proge.ct 
was also highly influential. * ' ^ / 

> . ■ . • ' ; ■ 

Policy Implications , . - 

There was no discussion of policy implications in the report. Data 
from^the study, however, have contributed to the palicy di scussio.ns con- 
tai^d In this paper. ' ' . " 



L. McDonnel and M. McLaughlin. . Prx)gram Consolidation and the State Role 
. in-ESEA Title IV '(1980). ' " 

• ^Scope of the Study • - v . 

T\itle IV represents the first consolidation .of federal education f^o- 
grams, funding a- wide range of items from school library acquisitions, to 
infiovative curricu^ar programs. The main objectives of this sfudy^were 
ti^reefold: t 



1; To describe how the Title IV program opera'ted in stare and 
local school districts; , ' 

2. To assess Title IV as an example of a consolidated program 
strategy and ' 

3. To use.^ Title IV as a basis for understanding the role af ^ 
the- states in implementi ng federal educati(5n*policy. ■ 



Data sources included: 



^ f 



1. A survey of Title IV program officials ahd state advisory ■ 
council members in 50 states; ' . , 

2. Surveys of public and nonpublic school officials in about^ 
600 lacal districts; 

* 

3. .Field v/ork jn ^ight state education agencies and 24 local 
education agencies; and 



4. Review of documents and other data sourcej. 



Findings 



Stated differed widely in their .Title IV-C funding strategies. Exam- 
ples of such strategies 'are:, competitive grants, exemplary projects," or 
proportionate funding for every LEA in the state. Most states allocated- 
a. large amount of money foi^ special grants to foster new approachesSto edu- 
cational problems. State priorities also figured prominently in allocation 
decisions. Thirty percen-t of the SEAs set asjde over half of their Title 
IV funding to support projects reflecting^riority programs and activities. 
Overall, states were either passive, servifig simply as conduits for- federal 
funds, or active, using the funds to enhance state priorit'ies. 

More specific observations about state education agency activities can 
also be drawn. Because Titles IVvB and IV-C were previously independent 
federal programs (Titles PI and III of the Elementary arid Secondary Educa- 
ation Act), they continued to be managed separately by most SEAs. There 
were few iircentives to consolidate these programs; consequently, states 
tended to continue administering the two programs independently. Rather 
than encouraging thetredef inition of, the state's role. Title IV-C Strength- 
erring fund.s supported roOtine activities.' In the. face oi such maintenance 
of the status quo, state advisory councils, surprisingly, were a'ctive a(nd 
i'nf luential . ^ j ^ 

The following general conclusions about the Title IV program v/ere 
drawn from the study: ^. 

• Title IV w.as ;)opular-ai1d well managed. 

• It was praised for its flexibility and ease of administra- 
tion. * . . * ^ 
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t Title IV did nat^result in the consolidated management of 
former categorical progral^s. 

t There was; considerable variation among state and local edu- 
cation agencies in terms of '^the substance, management, and . 
quality of. their Title IV-B and^ IV-C activities.' 

^ / ' ° 

t SmaVl. Title IV-B and IV-C grants can result in signf iQ^yrL^ 
Jocal practice improvement. 

t Tftr participation of eligible nonpublic sphools in Title IV 
programs was uneven. ' • • s • 



Policy Implications 

A number of recommendations emerged from this comprehensive study. 
The authors suggest that a successful consoJ idatioh policy: 

, t Must ^be built on substantive rather than political lo^ic; ; \ • 

t Must be accompanied by federal program reorganization; 

t Must represent more than a superficial ' shuffling together 
of what were previously- categorical aid programs; ^ 

t Must int^rate the notion thatNtlie effects of consolndation 
strategy vary with the .context'-^ito which it is introduced; 

t Must be so organized as ito allow the/federal role to change 
to respond to needs and frtterests that are modified as the 
policy and pr.ogram mature* 



J. Murphy. The State Role in Education: Past Research and Future 
Directions (1980). \ i 



Scop e of the Study 

5 * . X 

This ^aper reviews the- literajture on the role of the executive branch 
in state education policy making and'^plementation.* It then recommends 
additional areas of research, focusing specifically on executive agencies 
other tha'n SEAs and on S€As themsefves. . • " * 



*Four research categories were reviev/ed: - input/output studies, policy- 
making studies, policy implementation studies, and studies of the cumula- 
tive impact of state policy. • ^""^ — ^ 



Findings • < - . ^ c. ^: ' - 

Since the midicsixties, state education ag^nples' have grown in stz^e 
and assumed responsibility 1^or administering coraplex progrants, primarily 
because of increased federal aid. afid categorical^' programs. Although SEA 
roles have changed considerably, research kncfj^ecige about what /States do 
has not; kept pace. ^ ' " • • 

Findings from the literature reviews in^each of th^ four categories 
are summarized here: ; ' 

1. Input/Output Studies . Most studies find low correlations ^ 
between input measures such as economic indicators and out- 
puts such as state expenditures on schools* This line of 
research offers little potentially useful information op* the * 
role of SEAs in creating and implementing educational policy. ^ 



2. Policy-Making 'Studies . Considerable work has- been done in 
this area, particularly research on the role of state politi-. 
cal 'actors in educational policy making. "Further' research 
along some of these lines is important, but I suspect there 
may be better ways.;. to research and improve the state role 
in education" (p. ^ - 

3.. Policy Implementation Studies .^ This research analyzes what 
occurs after a policy has been established. Such studies.; * 
would document the influence of the SEA on local educational 

♦ programs. "The most important place to collect data on the 
state role is not the state capital, -but the schools" (p. 11)'.. 

4. Studies of the Cumulative Impact of State Policy * This^body 
of research cj)nsiders the Influence of central gbveroment ^ 
'policy on the'Tocal delivery of services. The increased ac- 
tivity of the states, the federal government, and the courts 
has led to studies about the effect - of government i^rven- 
tion on local educational programs. Although the, direct 
effects of central intervention s'e6m inconsequential, the 
indirect effects on ^ffttors .such as local agenda's, school j 
climate, and perception dT problems should be more thoroughQ^ 
documented. * ' . 



Policy Implicatiohs J , ^ 

A number of suggestions were included in the paper, namely: 

* • NIE might sponsor research oh the middle-management level 
and below in SEAs. Although these staff are frequently, 
in contact with schools, little is kfiown about them. ^ 

4 ' , . " - \ 

• Studies could be conducted on executive agehcies other 
than SEAs that play a key role in eduational policy making^ 
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^tat^is not frequently studied, including those somer 
times called^'worst cases," cpuld.be the subject of 
NIE-sp.onsbred research. 

« t. 

Comparative, studies of.a polTcy issjiie that emphasize, 
"people and process" would-be' useful. ^' , 

• The relationship 'b'etween internal SEA structures and'func- 
tions and their institutional Capacity could be studied; 

• To clarify t^e langiiage. and improve the accuracy of images 
lis'ed, research that creates better metaphors for the imple; , 
mentation process mtght be sponsored. ,• 

* . ' ' * 

• The impact and j'mplementation of state pol icies could be . 
studied, emphasizing: what is happening at the local' level; 

^the reasons for variation; the determinants of success'ful 
implementation; and SEA management strategies that 'effec- ^ 
tlvely influejicfe. local implementation. "A locally based 

• policy" implementation focus that looks vertically through 
the. system at a particular pol'icy initiative. . .Qffers a 
better hope pf illuminating the impact of the state role 

' in education" (p. 16). 

• The effects of state policies and their cumulative impact ofi 
schools should be studied. Here the ba'sic unit of analysis 
should be the LEA, the school building, or specific roles- 
such as school principal or teacher. 

• "NIE mi5ht postulate an ideal set of state-local relation- 
ships,... identify some model s,.v..co'llect data that examines 
-the tosts and benefits of these' model arrangements, and 
explore the conditions^^that make these- patterns possible" 
Pi -22).- 
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Introduction . 

* 

^ • • • • 

J 

Government agencies focus on the minimum. , Their primary role 
is to assure the minimum behavior of individuals -and organizations 
needed to keep society running. ' They do this partly by regulating 
minimum behavior (passing and, enforcing laws regarding traffic, va- 
grancy,, agriculture, education) and partly' by enabli ng. minimum behav- 
ior {providing highwaysV ^welfare payments, farm subsidies, public- 
schools). Beyond this mirftmum,* individuals and organizations are 
free^to^do as they v/ish... We i5an 'drive better than* the traffic laws 
require, ^and we c'an build private roads; we -can get more schooling 
tnan the. education laws require, -and we can build private schools. 

The principle that pub^lic agencies^ should limit their activities , 
in order to maximi/e private 'freedom 4s'ro(rtfed in pur earliest history 
as a nation and has shaped our political development. In our founding 
fathers', worda: '"That government gov8rris(best which governs least." 
This'principle cuts across local v state, anpl federal levels; it cuts 
across all. major functions; it cuts*acrross all major pol iticaTparty 
philosophies and platforms. ^ 

* Every agency justifies its programs as the minimum needed to main 
tain the social fabric. Even the Johnson administration's War on' Pov- 
erty, a high watermark in federal intervention and a program intended 
to improve life for millions, was justified as needed to provide a 
basic standard of^ living^ for the poor; that is, the poor were living 
at an unacceptable low level and had to be brought up to .a minimum 
,to keep society running. Otherwise, as James B. Conant explained 
at the time, social dynamite would build up in the ghettos. 

Any government agency that tries to operate "beyond the minimum" 
is subject to the'charge of unwarranted interference and unnecessary 
taxation. Fear of that charge is shrinking local government programs 
today. This public antipathy Was behind California's Propositiqn 13 
and Massachusetts' s Proposition 2-1/2; it was what elected President 
Reagan. It "^^ -precisely what is to be, expected in the wake of th^ 
War on Poverty. 




State Government Explained 



Let us concentrate discussion on state government, focusing our^at- 
tention oTi state legislatures. The legislatures are the de facto govern- 
ing bo'ards for' all state agencies because only the legislatures can raise 
taxes to finance »the operation of those agencies. 

This Is as true in education as in other^ state functions, despite 
the existence of state boards ^of education. State boards of educ^idn do . 
'not levy taxes to support the SEAs, and thus |re far less powerful in ^ 
their own right than most local boards of education, which do levy taxes . 
to finance the LEAs. The state governor is less important than the 
legis'lature "because the governor does not administer education (in most 
states). The state judiciary is less important than the legislature . , 

because the'^state board and the chief state school officer perform many ' , ^ 
judicial functions for the schools (in most states). Thus, we mu^ treat 
the state/ legislature as the maker of state education policy, subject, 
of course to multiple political pressures fr^pm local, state, and federal 
sourcel attempting to Influence state education poli(SiCi — 

' Legislatures Pay for Minimum Behavior ' ^It ' 

State legislatures justify their laws as being those r>eeded-to assure 
the minimum behavior of individuals and organ'izations needed to keep the 
state running. To legislate beyond the minimum would be to invite the^ 
charge of excessive government. This is^as true in education as in any. 
other state function. The- legislature must be able to say: We must do ^ 
this and we cannot do less. ' . ^ 

State financial aid to schools is virtually alWays justified (and 

\ actually cal_culated) as the Jowest-amount that will guarantee students in 
the poorest school district a basic minirjjum education. If the New York 
legislature provides $2,000 per pupil and tlje Mississippi legislature $50C^ 
per pupil, each will regard its appropriation hi the minimum needed. LEAs^ 
are usually allowed to exceed the minimum, but each state explains its 
contribution as the least it can do. The most Obvious proof of thisOies 
in the fact that LEAs chronically complain that the state does not evSn 
give the^enough -money to pay for state-mandated programs. Ask any LEA. 

• When state legislatures appropriate mone^to o^rate state adminis- 
trative agencies^ they^'appropriate the minimum needed for those agencies 
to \d.rr:j out the laws that the legislaturje has enacted and the governor 
has signed^ The most^obvious proof of this. lies in the fact that state 
agencies chroni9fi3Jy complain that they have tO{) little staff and money 
to Cb^rr^ out the l^aws. As1< any SEA.' ^ ' - ^ 

It is worth noting further that the legislature extends the principle. 
» of minimum government to the thir^l branch, the state courts. The courts 
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run forever behind--too many cases and too few judges* The legislature 
will enlarge the judiciary/ only when some minimum starfdard s^f justice Ms^ 
not being supplied to citizens--if then. 



LegiS'latures Rarely^ Pay for Improvement Beyond the Minimum 

Stafe legislatures rarely appropriate money for local government 
agencJes to Improve specific behaviors of or conditions fqr individuals 
Fnd organizations beyond some acceptable minimum , even in a state-operated 
and state-controlled organization like the public s-chools. For exampl^e, 
stat% legislatures rare]y appropriate money to improve education even in 
specific area^ lite a single grade level (say, kindergarten), a single 
subject "(say , social studies), or a single population 6f students (say, 
the handicapped). State legislatures are far_ less likely to appropriate^ 
money to improve schools in all grades and in all subjects for all popKI 
lations of students. ^ 

.Morever, state legislatures virtual ly <iever appropriate money for r 
administrative agencies to conduct general-purpose, broad-band, unfocused 
efforts to improve the general behaviors of i-nd'i vidual s or organizations 
beyond some acceptable minimum . TWs is as true -in education as in any 
otner state function. 

Imagine the governor- coming to the legislature, with a request for 
$J0 mi'llion to improve the operations of state administrative agencies 
or the behavior of st3te employees. The governor, who simply vvants to 
make things better than they are, caryiot say whether this sum. is for 
prisons, highways, libraries,' social agencies, hospitals, or colleges, 
and furthermore cannot point to any unsati^actory conditions. The. . 
governor will n©t get the $10 miilibn. "Slush fund," some legislators 
will say; "Campaign chest," some others^will say; "Political payoff,'" 
still others will say, while voting no. ^ 

Imagine the state highway commissioner coming to the legislature 
with a request for 50 ne'w positions dedicated to^improving the roads. 
The^commi ssioner, who simply believes that all roads can and should be 
improved, cannot say whether the improvement will involve primary roads 
or secondary roads and furthermore cannot point to any specific hazards 
on the existing roads. The commissioner will not get .the *50 positions. 

Now imagine the state superintendent of education coming to ±he 
legislature with a request for $500,000 to improve the schools. The , 
superintendent cannot say whether this is for elementary or secondary 
schools, public or private s.cho^ols, teachers or administrators^, music 
or mathematics classes, and furthermore cannot single out any*spffcific • 
shortcomings in need of correction. The superintendent simply wants ' 
to set up "a two-way process for communicating knowledge relevant to 

.educational needs and problems so that educational decisrionmakers and 
prattitioners can rati onaliy^consider alternatives to current practice 
^d the results of research and development in*improving educational 

^programs" ( NIE Program Announcement;^ State Dissemination Grants,, 
Program , ffT^. * • 
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Notjng that the legislative subcommittee finds. that description 
too general, the superintendent explains that the system must 'be both 
comprehensive and; generalized and must* '^involve the leadership and 
service capability to provide information and 'technical assistance in ^ - 
the, solution of problems identified by the dissemination agency or its 
cliente>e" (ibid,). ' The superintendent says that the system "shoulg 
provide access to all informatfon sources for all educators regard l.eys''*" 
of -subject field or role" (ibid,, FY 78), , ^<^V ^ 

✓ 

Asked by. the subcommittee how the 'system would function and how it 
would be structured, 'the superintendent replies th^ "the functions of 
such a system can be described in simple termsV/^^ SEA dissemination 
system should be able to (1) collect ^nd organize the information upon 
request, (2) get the information to the client, and {3)^assist the client 
in u^ing the information. Such a system, conceptually, could be com- 
prised of three generic components: (1) a r{ 'information resource base^ 
which contains the knowledge-based. products clients need; (2) linkages to 
connect the resources with the people who could benefit from them; and 7 
(3) a component to coprdinate the various activities needed so local edu-£^ 
cators can use the system for school improvement" (Madey, Vol . 1981 )♦ 

The superintendent wiTl not get the $500,000. Not because of that 
inexcusable jarge*, which 'is enough to lose votes on the su6committee. 
Not because of. the casu^ interchanging of "providing information" and 
"providing technical assistance,", which even the subcommittee k'nows -are 
entirely different ^activities carrying different price tags. The buga- 
boo lies in phrases like " all information resources for aJM educators" 
and "t+ie solution of problems identified by the dissemination agency or 
its cTientfele"--the request for money to conduct qejieral*purpose, broad- 
band, unfocused efforts to improve behavior beyond some acceptable rginimum . 
The subcommittee chairperson is likely to dismiss the request with the 
directive, "If it's not bcjsken, don't fix it--not at the t-axpayers' ex- 
pen^, anyway." " - 

Eve^n if our hypothetical governor or highway comrpissioner or super- 
intendent of education could convince the legislature that 'some people 
are not eating or so'ftle bridges are out pr some students are hot learning, 
the legislature still woitlji^not vote genefral-purpose improvement funds. 
What it would do instead-M^ anything at all--would be to mandate and/or . 
enable processes to br>^g nutrition, bridges, or students up to*the ac- . 
ceptable minimum. Show a state legislature a serious social problem, aad 
it will adopt a specif ic '^oial solution--the cheapest one it can find. 



Legislatures See SEAs as Bureaucracies that Exist for the Enforcenjent or ^ 
Enablement of Minimums^ _ 

An examination of the education laws in any state will reveal J^hat 
the legislature attends to the basic operation— not the 'improvemen<--of . 
schools: accrediting teacher training institutions, constructing school 
buildings, transp5?\ing students to schools, scheduling the school day 
and requiring that certain subjects be taught, distributing sfate finan- 
cial aid, requiring local statistical reports* It follows that 
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legislatures expert SEAs to serve as bureaucracies ifor'the enforcement or 
enablement of minimum standards for school operatibns* Inasmuch as the 
minimum is the topi<: of the laws, the minimum is the job of SEA personnel. 

Appointing highly educated professionals—especially able and'- 
ambitious professional s--to SEA positions almost always creates , 
tensions between the professional impulse to' improve ngs and the 
job requirement to simply maintain things. ^ . . 

Today's SEA professionals are embarrassed to work at the minimum, 
to deal always with the h-indmost, to be forever bringing up the rear 
The professional ethic calls for leadership, for acts of improvement; 
the bureaucratic ethic calls for inspection, for acts of enforcement. 

^?.\A century ago, when many classroom teachers did not have the bene- 
fit of a college education and many administrators were ^hardly better 
off, SEA personnel acted chiefly as inspectors of local schools. But 
today's college-educated teachers and administrators require ^college- _ 
educated professionals in SEAs. The SEAs admittedly bave difficulty ^ 
attracting and retaining highly qualified professionals, but those 
they do, manage to attract tend to be more interested in leadership for 
improvement than in enforcement of the minimum. 

State legislators continue to expect SEAs to monitor LEAs so that 
minimum standards -are met. Considerably higher aspirations for SEAs, 
articulated by 'professional leaders for half a century, have not caught 
the "imaginations (let alone changed the minds or loosened the purse 
strings) of t^eJlegislatures in most states. 

Here is an example of the evolution of SEA staff, in one of our 
southern states. In -the^ early years, SEA specialists in various subjects 
inspected LEA behavior--especial ly teacher behavior. Gradual ly,- th6 spe- 
cialists moved away from the inspection des:ired by the state' legislature 
and'tward consultation with LEAs about interesting and innovati ve-^if . 
- unva^li dated— Ideas. ' Now the'state legislature has adopted'an a,ccounta- 
' bility law, and the consultants are bacic at their inspection functions, 
which are gauged to assure^.the legislature that all LEAs^ are performing 
at the minimum. . ^ ' * 



Federal Agents Invade SEA TerritQ, 





\ Large state administrative aoencies are an embarrassment to state 
legislators, who prefer smal 1 1^,; efficient agencies just Jarge enough 
to enforce laws-and 'distributive funds.. SEAs are al read^twice as 
large as 5tate legislators wbul'd make them. • ^ 

About '50 percent of SEA personnel are.paid by federal func|s to 
administer federal prograw. These are not state^agents conducting 
state business, but federal age^nts conducting federal business. .Although 
they ar^ appointed by state officials and are responsible to the state*' 
sDperintendent, these federal agents respond as much {or more) to , 
federal guidelines and federal officials as they dp to state priori- 
ties aQd state officials; 
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Jhis pattern of, housing federal agents in state agencies is not 
limilfed to the SEAs, of coifrse; it is common in social welfare depart- ^ 
ments, highway departments, law enforcement departments, jnd many 
others. It began in earnest in education with the enactment of the 
'Smith-Hughes Act in 1917, and' to this day federal agents in vocational ^ 
education are more numerous than thej^^are in any othei^ educational 
field* But they have since been jo^'ned by administrators of programs 
for the handicapped, the disadvantaged, %he bilingual, the recently 
desegregated, women, and others. , - » 

Why have^ongress and the federal Department of Education assigned 
'these federal agents to state agencies? Is Congress working at the 
V minimum like other legislative bodies, or is it violating the principle 
of least government? Most federaL.laws follow this principle, assuring 
the mi nimpii^ behavior of individuals arid organizations needed to -keep the 
nation^ wo-rking. ^ Concepts of that mnnimum change over the years as the 
society evolves, as the major political parties offer slight variations 
in philosophy and programs to the electorate,' and as advocacy groups 
lobby more or less successfully for what they want. But the Congress 
usually justifies what it does as being the least *it can do. Whether it 
is dealing with dams, dredging, highways, the post office, social secur- 
ity, welfare, health, commerce^, parks, agriculture, or the military, it 
usually claims to be meeting essential public needs at the lowest pos- 
sible cost. Certainly, it is usually confronted by a majority of voices 
clamoring that it is doiog less than is necessary, less than it should. 

What about -Congress *and education? Has CongresFobserved the prin- 
ciple of least government- -a.n appropriate policy particularly inasmuch 
^ as. education is a state function?^ Or have the major ^federal programs 
'of the past 20 years shattered that principle? ^ 



The Federal Government Enforces and Enables Minimums for Minorities 

In education, the federal .government serves as a court of last re- 
sort. People go to the feds when they can't get what they want from 
the localities or the states. The people who do so are the minorities. 
That figures* If they were the majority, they coL^ld get what they wanted 
by taking local action, or more likely--given the fact that local schtjol 
districts are' relatively closed to ^public pressures--by taking state^ ^ 
action. The landmark events in federal l-Ag^sslation have taken place 
when localities and states di^i not give a vocal<mincr)ri ty what it wanted. 

It is hard to understand why the federaKgovernment ha^s a more 
sympathetic ear for minorities than do the localities^ and the^states, 
but it jBay be the crowning achievement of our federated system of govern- 
ment that this is the case— that minorities have their maximum influence 
at the highest levels of government. Is it because of the Constitution? 
Is it becausf^the president and the Congress and the Supreme Court fi- 
nally escape t+ieir majority constituencies and learn to administer and 
legislate and judge for all the people inclOding minorities? 
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Whatever the cause, landmark -federal laws are landmark minority 
triumphs. Take these examples: - ' , 

• Smith-Hughes in 1917--when the vocational' educators and the 
employers who supported them finally persuaded Congress > * , 
to take vocational training ou£ of the shops and factories 

and putit into the schoolhouse, af^er failing to convince 
the "general educators" who made up the majority in the - 
'localities and the states., 

• Brown vs. Topeka in 1954--when the blacks finally persuaded 
the federal courts that* they should go to school with the 
whites^, a point they had failed to make with the majority 
in many states cind most localities. 

f The Civi.1 Rights Act in 1964--when the minorities finally 
convinced the president that it v/ould take more than Brown ^ 
vs. Topeka to get the majority in many states ^nd localities 
to follow the Ct)nsti tution. ' ' . 

• The Elementary and Secondary Education Act in- 1965— when the 

. disadvantaged finally made it -clear that compliance faws were 
not going to be enough to bring theip children up to 'an ac- 

' ceptable minimum; that it would take a bil 1 ion xlol l-ars (four 
billion dollars today) which the majority in the states and 
localities would not supply.- 

• The Education for All Handic^p^d Act in 1977--when the par- 
ents of the handicapped finally persuaded Congress that the 
individual differences among their children were so great 
that each one required a tailtjred educational plap, something 

the state and loc^l majorities had not supplied. ' " ^ 

It seems-that all the Congress has done, in keeping with the equal 
protection clause of th^Constitution, is to require minimum behavior -by 
the majority and enabl^inimum behavior by minorities simply to keep 
the nation worki ng. ^ ' ^ 

The whole history of federal alttivity in education, can be understood 
as continuous monitoring of the ^stem which" the National 'Center for. 
Educational Statistics does today) punctuated by irregular interventions 
to rescue some group that has fallen throu-gh the' state and local educa- 
tional "safety net." Occasional ly,it is not a particular group but some 
particular beh«v1or on -the part /i> students as a whole that falls below 
an acceptable minimum.- Professional educators welcomed the .1958 National 
Defense Education Act, while wondaaNng at its 'odd title--Cpngress's way 
o1^ indicating that the nation had to keep up with the Russians, who had 
just launched Sputnik- 1 the year before, by strengthening instruction in 
mathematics, science, and foreign languages and by improving guida^nce 
counseling. Clearly, Congress could do no less than defend the nation— , 
a clear federal obi igation— by getting learning up to a minlfum inter- 
national standard. • , ^ < 

" . . . 



•Tfte late 1950s, th.e 1960$, and the early 1970s saw a higf] watermark 
of 'federal initiatives >n, edyca.tion. Almost all of this activity was 
directed toward assuring minimum behavior for mi^norities (as exemplified- 
by ESEA Title I, by far thi largest program). Congress put more money 
into those new actiVIt^^ throughout the 1970s in a continuing effort^ to » 
get minorities up to a-i|iinimum. 



The ^^Hf^al Government Reaches Beyond Mini mums to Improvement—Sometimes 

During those same years, Xongrfiss' also ..launched a few sma-11 general- 
purpose, broad-band, unfocused activities to improve school performance 
above an acceptable minimum. Those of greatest present interest^,were 
enacted in 1965 in ESEA Title IIU TitJe IV, and Title V. Nooe-^of these 
was attached, to a' major funding program (such as vocational education 
or the education of the .handicapped or the disadvantaged). Significantly, 
none of them has grown as much as the major funding programs have grown; 
even durin§^the two ^•emarkable decades just ended. Congress has beeir^more 
generous when worki ng at .the minimum, as should be expected, than v^orking 
above the minimum. ' . ^ , 

In any case, the.^fedpral' government placed ^ number of federal agents 
in SEAs; to administer, these new programs, inasfuuch as it is impractical 
as well as impolitic f or ^tbe federal gdvernment to deal with LEAs without 
going through SEAs.^ v^We are talking here about new programs directed towarH 
improving schools,, including schools already performing above the minimum. 
Indeed, in the competit^iye^ grants program, the more capable LEAs wrote the 
best proposals and ^on^^^a disproportionate share of the grants in the early 
years. Sorfie states moved to correct this pattern, shifting money to LEAs 
performing closer to the nffnimum, an almost instinctive state behavior., 
.That kind of state actton--usTng federal improvement money to get- locali- 
ties up to an acceptable minimum--il lustrates the inevitable tension aris- 
ing when minimum-ori-ented state agencies administer improvement-oriented 
federal funds. • , 



States Do Not Replace ^W'ithdr^^wn Federal Agents 

The ke^^ point is ^at the federaf government has 'to place federal 
agents iri state agencies to achieve federal purposes. What can we predict 
the state legislatures wi]l 'do when the federal agents are withdrawn? 
Replace them with state agents to Cd^rry out the federal purposes? Or echo 
vihat'LEA'^s uniformly say when asked to^'carry out state t^urposes at local 
exj)ense: "If they want ijt done, let them pay for it." States have had 
sTnce. 1917 to replace fedferal vocatibr\al agents y/ith state vocational ^ 
agents, administering the 'programs at. no cost to the federal government 
and passing the federal administraty9epsavings on to LEAs. Not one state 
has done so. Not in 64 years. /?na*^TC5cational education is a federal 
fundi ag prp^K^m^/dot a federal service program. It provides mon^y to 
LEAs--noi^jn f Vm a t ion, tecTiaical ^assistance, and training--and thus is 
likely to akous^* strong LEA support. ^Yet no state has supplied the needed 
five percent to cover the Administrative costs of operating vocational r 
education. - ' ^ ' 
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' What a Stretch "Of the imagination it takes to picture a state 
legislature replacing ^federal' vocational agents with state vocational 
agents! Of »caucse, the federal government has not demanded it. What • 
if It did? What if the federal government gave states no^money to 
administer federal vocational funds, but made states pay the five 
percent admjni^rati ve costsVas a condition of receiving vocational 
funds, every, dotlar of which had to be passed on to LEAs? In that 
case, legislatures would pay grudgingly because of irresistible # 
political pressures from LEAs' and local taxpayers seeking the fed- , 
eral, fund?— but 'grudgi ngly, saying, "If they want it done, why don't 
they pay for it?" . ' ' 

Now consider a federal funding program far smaller than voca- 
tional education: ESEA- Title II (now part of Title IV-B, a formula 
program providing money to every LEA for media and materials).' The 
money helps some LEAs maintain a minimum, stock of essential instruc- 
tional aids. Would Stateje^slatures supplant federal agents with 
state agents' if th^ were a condition of receiving the federal money? - 

.Probably so,"althougt> pressure frorrf LEAs would diminish in proportion 
to the amount of money at stake, exponentially less than in vocational 
education. (There is at least one identifiable local constituency 
of school librarians that might lobby for meeting the federal con- 

'ditions. ), ' • • / 



Now consider another federal funding program far smaller tKan voca- ^ 
tiona'l education: ' ESEA Title III (now part of Title IV-C, a competitive 
grants program for LEAs). Would state legislatures supplant fed^eral ' 
agents wijth state agents if that were a condition of receiving the federal 
money? Perhaps, although pressure from LEAs would be les^ than that for 
Title IV-B, and would come from fewer LEAs, since not all win the grants 
competition.- And there is no Identifiable local constituency to lobby for 
meeting the federal conditions. . , 



These shoutd be relati^ly easy responsibilities for state legisla- 
tors to meet, we. might think, since the federal government would be asking 
them, to pick up only about Yive percent of total program costs--the amount 
needed for admini^stration. But we must wonder whether the states would 
spend even five percent to provide state agents to Achieve federal pur- 
poses. / ' * - ' ' ' 

Now imagirve- an enormously harder test for state legi slatures--a test 
20 times more difficult. Ask the legislatures to pay 100 percent of the 
federal cost, to take over vocational education," Yitle IV-B, or Title IV-C 
completely at state expense. The legislatures would not do it. No one 
today expects state legislatures to replace shrinking federal funds, es- 
pecially for programs like Title IV-C, a generaj -purpose, broad-band, un- 
focused* program to improve schools beyond an acceptable minimum. ^ 

Capacity-Building Grants Are No Exception 

Take-the state dissemination capacity-building grants as one example. 
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Hece is a program well designed and well^mi nistered by NIE.^ It -is not 
*a funding program for L£As, so it does not have a deeply interested local 
constituency. It Is not addressed to the minimum, but iso'nstead a gen-^ 
' eral-purpose, broad-band, unfocused attempt to improve any arid all schools 
by providipg information and assistance regfarding research results, inno- 
vative products, and validated practices. It was Suggested earJier in this 
paper that a state superintendent could not convince a legislature to^fund 
such an activity. But could the. superintendent convince a legislature to 
continue the activity once the. federal government had demonstrated its 
value wjth a three-year grant to the state? probably not, all things con- 
sidered--ir>cluding the economic problems* states will face in the first 
half of the 1980s. The justification behind this prediction is all of the 
foregoing reasoning. - If 'improving schools beyond' qn acceptable minimi/m 
is not tlje role of -state government--and indeed is only a marginal and 
currently diminishing role' of the Tederal government--state leg^latures 
will not replace federal improvement agents with state improvement a|ents- 



The best analogs vfor the capaci1;y-buildljig' grants are <the ESEA 
Title Ill grants to.LEAs and t+iS ESEA Title V grants to SEAs (both now 
consolidated intb Title IV.-C). Few of th^se were continued b/ localities 
and states, a long-standing and perhaps intractable problem: "States are 
trying, to improve what has been a rather poor record for prpject con- 
tinuation once -federal funding ends" (McDonnel and McLaughlin, 1980). 



• Capacity 'Cannot Be "Builtl' . 

. 

Why were those programs not continued"? The time-worn analogy of 
pump-priming OS useful here^ since most people hoped those grants 
would prime state^and local "pumps." A''pump won't pump, even if there 
is a pool of water> beneath, Ontil someone pours in a bucket of water 
. at the top--say, federal "water." But the pump also will not wopk Sin- 
less there is that pool of. water down below— say, state or local "water." 
There has to be a latent capacity for -the. pump to keep working once 
the federal water has' dried up. m 

• • ^ 

The term "capacity building" should be seen in this context. Capacity 
cannot be built. It must be an inherent characteristic of states and lo- 
calities.. The sensible federal strategy would be to ffnd unused state and 
local capacity that could be activated with temporary federal money. A sim- 

* * pie definition of capacity to continue a federal program is: motivation and 

money. Those states and localities that discontinued Title IV-C activities 
lacked.AQe or both. ^Our prediction that states will discontinue the serv- 
s "ices they have operated with tt^n'r dissemination capacity-building grants 
*is based on the partly .substantmed assumption that they lack the motiva- 
tion and/or the money t<:i continue a program not addressed to the minimum. 

Here is what the background papers have to say about state-level dis- 
semination pump-priming j^y the federal ocLvernment*: 




f f^ost state's in the [State Capacity Building Program] evidence 
movement toward i nstitutitfnalizing, their dissemination capacity, 
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afTthough it is still too soon -in that process to determine if 
the dissemination systeni will indeed become an accepted part of 
SEA program services offerings* (Madey, VoK-V, 1981) 

I The survey gives a clear indicatit)n that disseminati-on 'services 
are not considered to be institutionalized functions of SEAs* k 
Only seven studies have approved state board of education poli- 
cies in this area;- 18' have written administrative procedures, 
and 20 show a "dissemination unit" on the SEA organizational 
chart ♦ Those with policies and procedures stated that the NIE 
capacity-building program was significant in their development. 

.{Martin,^ 1981) 

\ Funds for school improvements come from several sources, but . 
more often from federal pr;'og)^ams. State fupds, however, are 
used by 37 states. Forty-three states use Title IV-C\ Thirty 
use special education money and 29 use Title I. Funa$ specif- 
ically for dissemination programs are signf leant contributors, 
also; 37 states apply NIE funds to their programs, and 30. 
states use National Diffusion Network funds". (Mart in, ^1981 ) 

\ Easily the most Important project or service available to 
SEAs as they have developed their school improvement programs^ 
has been the NIE capacity-buildiQq program.. . .Another important 
source, of assistance has been therllE-funded, Regional Exchange 
project. ' (Martin, 193T) 



t Although states allocate a portion of IV-C strengtheningfunds 
to all the" express purposes of the strengthening component, 
various aspect-s of administrative sup(5ort (including fiscal 
accountability and data system?) remain the highest priorities 
for the use of strengthening funds. Such state-Tevel develop- - 
mental activities as training and dissemination/eceive a much 
smaller share. (McDonnel and McLaughlin, 1980)^ ' ^ 

One theme r^nirig thpoughout the papers is that of state-financed 
dissemination activity. But that phenomenon is so poorly described 
and so r^T^'X:/ illustrated that' the issue may be an artifact of imprecise 
methodology rather than an actual findi'ng. (This ^ossibil ity is dis- 
cussed lat^r.) In any case, it seems clear that thus far fe'deral funds 
dominate the dissemination scene. ' 

4 

SEAs and LEAs Convert Improvement Money 'into Operating Money, 

* 

Like the bureaucracies^ tha]t they are, both SEAs and' LEAs tend to , 
absorb money intended to improve their operations into budgets for con- 
ducting their operations. This transformation brings the organization 
back into equilibrium out of which the improvement money moved It; reg- 
ularizes operations; finahces the improved procedures; and reduces, 
outside 'pressures for further improvements. This customary behavior 
becomes stronger when -money runs short, as it is doing today. 
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Here is what the background papers say about this transformation: 

t Three fourths of the districts in our sample allocate their 
^ funds on a per capita basis. In these cases, there is little ' 
that^can be called .a IV-B program a'^nd'^school site personnel 
uSe their IV-B allptment.to supplement ongoing activities. . 
(McDonnel and-McLaughlin, 1980) . \ * 

f Under Title III few states attempted to pj^escribe objectives 
for local projects^ Now [in Titl/lV-C], about 30 percent of 
^ - ^ a^l SEAs set aside slightly more rhan one half of th§ir funds 
to support projects r^flecti^ng -state priorilnes. (McDonnel 
{ and McLaughlin, 1?80) , ' 

f It is possible to argue that [ESEA Title IV-C] strength- 
ening funds^Dformerly ,ESEA Title V] are sufifilementing what 
have come to be seen as rouMnie SEA activities. Still, as 
states face tighter budgets, it is .likely that without 
strengthening funds these central services would be sub- 
stantially reduced, if not eliminated. (McDonnel and 
McLaughlin, 1980) 

. t The Murphy study provides an extensive descr>ption.rof 
USOE/SEA relationships w'i'thin the context of .ESEA Title V. 
It describes how a program, originally inte[id?d to fund* 
"quality"' projects that would strengthen St'As, became 
essentially "free money to SEAs with little federal 
"-accountability." (McKibbin, 1981) 

Some states have had to depend Increasingly on federal revenues and 
federal agents to achieve state purposes. For'example, some states -have 
moved to engage federal agents in general-purpose improvement activities 
going beyond the earmarked federal programs they are employed to administer. 
And some states have used the flexibility of certain federal funding pro- 
grams to Bend th'ose>rograms to fit state purposes, rather than giving 
LE'As the federal latitude along with the federal money. Given this trend, 
it would be reasonable to predict that if NIE continues to fund dissemina- 
tion capacity biiilding in SEAs," but under looser guidelines, the SEAs will 
use the money to secure local .compliance with minimum standarcjs in impor- 
tant state programs rather than continuing to use it for general-purpose, 
broad-band, unfocused school, improvement activities. 
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Dissemination Explained 



The field of, di^semf nation suffers from intellectual sprawl. The 
goals, concepts, vocabulary, activities, and criteria for succe'ss in 
thevfield are a mile wide and an inch deep. The situation is 'Somewhat 
comparable to that in evaluation, where 20 years of federal activity 
and researpH (not state activity and research, please note) have so 
stretched the field thatjit spills all the way from pre-planning, goal 
setting, and program selection to post-program audits, secondary anal- 
yses, and evaluations of ^evaluations. However, the situation in dis- 
semination is much worse, p^tly because, as Mur{)hy (1980) points ' 
out, "So far, education research on the states has not attracted an 
'oversupply of those proverbial 'first-rate* minds." As a member of 
that field, I agree. 

About 20 years ago, "dissemination" meant informing people about 
the results of research .devel opment, a straightforward concept lending 
itself to straightforward study.. Before long, the discovery was made 
that informing people does not improve school s* Of course not. But 
dissemtnat/ion specjalists and scholars were overv/helmed, it seems, 
by that discovery. Moving forward on the ambitious assumption that 
disseminatTOR^is supposed to improve schools, they studied what it 
does take to improve schools and stretched the word to cover every- 
thing they found. 

Th^ result of tv/o decades of thinking and writing about dissemi- 
nation is a group of murky concepts and value-driven generalizations 
that do not describe the actual phenomena. I have encountered many 
problems in examining the literature (including but not limited tp the 
background papers). Here are some of them. 

1 . Recipients. Are Not Active Seekers of Nev/ Knowledge 

The first was a value problem: No self-respecting 
professional v/anted to be regarded as a mere recipient.- This 
required the' construction of a model ' depicting recipients 
as active .seekers of nev/ knowledge, in no way subordinate to 
disseminators. This politically palatable, egalitar4an notion 
does not ^scribe the behavior of the two million professioiT^s 
in education and most certainly does not describe'the behay^iw 
of the ^ bureaucracies that employ them.' But it is an admirable 
professional image--;drawn, be it noted, from the idealized 
behavior, of the finest research scholars. ' ^ . . 

2. LEAs Are Not "Clients" of SEAs 

Another problem was one of nomenclature. Rejecting the 
analogy of buyer and seller (presumably because it smacked 
of the commercial), reseafchers adopted the analogy of 
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professional and client, dg^ting ^he. qualifications of^dls- 
seminators and connoting a more egalitarian relationship. LEAs 
.became clients of disseminators, including disseminators housed 
in SEAS. Now, ap LEA is no more a client of an SEA than a 
school is^a client of* a school, di strict central office. The 
^term "client," no doubt attractive to professionals in LEAs and 
'SEAs, denies all the authority-laden legal relationships binding 
SEAs and LEAs and is an inadequate conceptual tool for* studying 
either SEA dissemination activities or SEA ^school improvement 
activities. 

Z^r The "R" in ERIC Is Not Research . 

Yet another problem was the 1960s decision to broaden 
ERIC from a research file to'a research and practice file^and 
te g\)hm^ the second word of its name from "research" to "re- 
sources." Since at that time dissemination was thought of as 
equivalent ,to the di stribution *of ERIC-type information, Vfie 
definition of dissemination automatically expanded to fit what- 
ever vfts added to ERIC, which soon became just about everything 
in print that was not copyrighted. 

4. * Dissemination Is Not a "Tandem" Act 

•Another problem was sloppyjogic. Scholars posited a, 
' series of' tandem behaviors linking disseminators and recipi- 
ents, each responding equally to the, behavior of the other: 

^ Disseminator : Behavl-or la Behavior 2a Behavior 3a 

•t Recipient : Behavior'lb Behavior 2b Behavior 3b 

' . This image of dissemination assumes that every transaction in- 
volves two-way communication between the disseminator and the 
recipient. Some experts, on the other hand, ?tjggest^^t such 
communication is not necessarily fequal or two-way.y TheN)is- 
semination Aqalysis Group (DAG) characterises disseminati>an as 
a four-part process of spread, exchange, choice, and implementa- 
tion. "Spread" is the resppnsibilityrof the disseminator; a 
. "choice" is made by the Recipient; a^nd "exchange" involves both. 
The DAG definition suggests an attractively interwoven series 
: of. behaviors with egalltatian overtones. But iris a wholly 
.SiSX:' 'inadequate description \^ the dissemination process, and t.hus .a 

useless thinking tool. 

5. Dissemination Is. Not Just Any Distribution of Jdst Any Information 

\ ^Another difficulty was that the definition bf cHsseminjation 
was derived from the vagaries of administrative practice instead 
of from dissemination theory. One question from the survey done 
by Martin (196^) exemplifies this deficiency: 
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. Question D5. Which of the following activities/ 
programs are administratively a part 
of the dissemination unit? 

39 information services (ERIC, etc.) 
, * 75 public information 

its National Diffusion Network ^c>: 

27 validation of state programs 
computer/statistical services 
support services (radlo-TV-f ilm, 
publications, graphics, printing, 
media) 

12 other ^ 

What kind- of thinking Is this? Dissemination Is allowed 
to Incfude public relations Information, the comfiut^, tele- 
vision, and the print shop. Any distribution of an5Hirfarm3^ 
tlon to anyone by any < means ml.ght ttius be construed as "dls- 
semlnatlort." 

Dissemination Does Npt Equ^l School Improvement ' ^ ^ 

The worst single problem In'the field Is the use of the 
term "dissemination" to mean simultaneously Informing people 
and improving school practice . This Is si 1ght-,of-m1nd, and 
the magician loses hold^of the concepts along with the audi- 
ence. Here are some citations from Martin's survey illus- 
trating the confusion of terms:. 

Question B5 . Is there %ny state legislation mandat- 
ing the dissemination functions? 
TJ_ yes 41 no 

Martin's narrative : Only -11 states have legislation 

mandating school improvement 
. activities. . 

Que'stion F2 . In your opinion, whic^y of the projects 
and/or activities listed above has been 
most significant in increasing your SEA's .^.^^ 
ability to develop a dissemination/school 
improvement program? , ; 

MadSy, among others, joins Martin Jji equating the two terms: 
.'^Because SEAs Vary in their organization and approach to school /- 
improvement, and because relationships among SEAs and LEA^s are 
complex J no one model or approach to developing an SEA dissemina; 
tion unit or system will fit all SEAs" (Madey, Vol. V, 1981). J 

Dissemination Is Not Defined Consistently 

Martin and Madey are no more wrong than other wr1j:ers who 
traffic in mutually destructive definitions of dissemination. 
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First, consider the (comparatively benign) definition used 
by NIE's Program on Dissemination and Improvement of .Practice 
in. its Program Announcement; State Disseminatim Grants Pro - 
gram (FY 75): ~^ 

A two-way process for communicating knowledge rele- • 
vant to educational needs and problems so that 
educational decisionmakers and practitioners can 
rationally consider alternatives to current practice 
and the results of research and development in 
improving educational programs. 

"Rational consideration of alternatives" stops far short of 
actual implementation of new programs. ' Now compare the Dis- 
semination Ana^lysis Group's four-part definition of dissemina- 
tion as: "spread, exchange, choice, and implemehtation, the 
last defined as the facilitation ef adoption installation 
and the ongoing utilization of improvements." 

The American Regi'stry of Research and Research-Related 
Organizations in Educatioa (ARROE) project included 'dissemina- 
tion in its definition of research and related activities: 

An acl^ivity had to be systematic and designed to es- 
tablish new facts or principles (research); to invejit 
new or improve existing solutions to educational prob- 
lems (development); to assess 'the effects of existing 
programs or determine the feasibility of new ones 
(evaluation);^ or to disseminate R&D results. (Sharp 
and Frankel,.T979) • ' 

While it 4s not clear whether ARROE includ^ either th6 results 
of evaluatwn studies or evaluated products^ its definition 
Of dissemination, it is clear that ARROE did not Include prod- 
ucts that did not involve systefnatic procedures. 

Brickell (1970) permitted the term tovinclude only in- 
formation firmly' rooted in research: "Dissemination is defined 
as the pending of information either about- the results of re- 
search or the products of [research-based] development or the 
[researK:h-based] me'^thods and materials being demonstrated." 

The ARROE and BrickeTl studies use similar definitions, but ^ 
were 'separated by ^10 years during which f*ar broader defini- 
tions were' formulated and gained widespread use. Such oscij- 
lation--or random varia-tion--in definitions does not -suggest 
progress in bringing the field under theoretical or $Vea*' . 
conceptual control. , ' { -[ 

Di-sserfii nation Study Methodology Is FguUy 

Quite apart from definitions, the study methodology in 
the field has-been too sim^l-e to handle the complexity of 



the phenomena. For example, Brickell, Sharp arfd Frankel, 
and Martin all depended on survey questionnaires to collect 
data' about SEA activities and- did little or nothing to 
verify accuracy of responses. Given the strong profes- 
sional leadership leanings of SEA personnel, the divergent 
definitions of dissemination abounding in the field, and 
the* uncertainty of SEA personnel about the research base 
underlying the information and practices they are diss^mi- . 
nating, the answers to survey questionnaires probably were 
not rel4able even when the questionnaires^used clear defi- 
nitions of dissemination. 

Probably the ^nost reliable stu3T^r^tH=€ those focusing 
on specific federally funded programs that are easily dis- 
t(inguj shable to state personnel, such as Miadey's on the 
State Capacity Building Program. Survey methodology is 
probably not sufficient-l^^ sensitive to disti^nguish between 
the activities of federaf and state dissemination agents; 
state- and federally funded activities; dissemination and 
other school improvement activities; dissemination of in- 
formation abCHit research-related products, val idated* prac- 
ticeSy and statesregulations; working at the minimum or 
•working at the ma^rfipum. Only face-to-face interviews in a- 
tase study framework are sensitive enough to disentangle 
al 1 those activities. 

But better methodology will not help if conceptual 
clarity is lacking. For example, given the /ast territory 
claimed under the flag of dissemination, most SEA personnel 
engaged in instructional activities could describe them- ' 
selves as being engaged in dissemination for much of their ' 
day. This may be why Brickell, Sharp and Frankel, and 
Martin picked up so much state-funded dissemination ac- 
tivity and so many state-paid dissemination personnel with 
their questionnaires. 

It seems odd that "studies of the state role in disr 
semination and school improvement -cannot accurately locate, 
examine, and describe state-sponsored activity in. detail. 
It seems curious thaj reports on SEA behavior refer in a 
•general way to state acti vity--but when the zoom lens closes 
in, we seem to be looki ng always at the activities of federal 
agents. Without better definitions, and better methodology, 
we cannot know whether there is any state-sponsored activity 
to study— either state-initiated without^ federal stimulation 
or state-continued after federal pump-priming. 



Implications for HIE Research on * 
the Role of SEAs in' Dissemination 



Here are several suggestions for how NIE should study dissemination ^ 
^ in the future: " \ 

1. Clarify concepts in the f1eld > This cannot be done by 
making every concept me'an more and more, but by making 
e^^eW concept mean less and less. It requires that the 
behaviors of disseminators and recipients be clearly dis- . 
tinguished, clearly described, and cleanly lab^ed. 

^ 2. Abandon the idea that dissemination alone is supposed to 

improve schools . This is the overreaching idea that has 
' bloated thje term beyond recognition, has saddled dissemi- ^ 

nators with an unfair and impossible task, and has given 
dissemination scholars too much to/study. RTedefinition 
requires a better analysis of school improvement activities 
and of dissemination as merely one such activity among many 
others. It requires that dissemination be understopd as a 

single tactic in a school 'improvement strategy, a tactic ^ ^ 

intended>^to produce a specific: effect orr the recipient—a | 
necessary but insufficient , effect to improve school^ 

3. Examine each SEA in a vertical context extending fromjthe. 

state legislature through the SEA and the ir\tennediate ^ 
' units to the LEAs. 

4. Study the natural behavior of SEAs regarding dissemination 
in the absence of federal funds or federal agents. Make 
retrospective studi|^ or monitor future behavior of SEAs in 
operating programs mtouched by federal intervention. 

5. Take a longitudinal, look at the behavior of SEAs before, dur- 
ing, and after the federal funding of dissemination.. Make 

. retrospective studies or monitor future behavTbr of SEAs in 
oper-ating programs where -federal money comes and then goes^. . 

] 6. Use case study methodology ir^dealing with SEAs , including 

* ' face-to-face inter\^iews to collect .data and rich descriptive 

narrative to report it. 

7. Test -these hypotheses : . . 

.a. State^l'e^latures think that it is their responsiblity 

to ass^^^ ml4iimum performance of schools ^nd students, 

and that they must justify their statutes and, their 
$t^ffing of SEAs accordingly. , " - 
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d. 



e. 




State legislatures do not think it is their irespons^^ ^ . 
bllity to finance general-pur'pose, broad-band; unfocused 
.^school improvement activities and they will not staff 
SEAs for such activities. * " | 

SEA -personnel do not wish to limit their attention to 
minimum performance of schools and students, but instead." 
wish to engage in improving performance across the entire 
of school quality. ^ ' * ' ' 



spectrum 



LEA personnel want SEAs to provide money rather than 
leadership, particularly leadership for general-purpose, 
broad-bafid, unfocused school improvement. (Small LEAs 
in rural areas should be an exception.) - 

^Intermediate unit personnel do not wish to limit their at 
Mention to minimum performance of schools and students, 

but wish to^ engage in improving -performance across the 

entire spectrum of School quality. 



LEAs want j'ntermedi ate units t<) provide assista/ice (vo- 
cational courses-, shared teacKers, data DO^ssing, 
media rentals) rather than leadership, p-HPIftularly * 
leadership tor general -purpose, broad-band, unfocused 
school improvement. - ' • ^ 
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